The Second Reformed Presbyterian Church was organized in 1835. On September 20th of that year, Reverend Samuel W. Crawford was installed as its first pastor. In May 1836, the congregation was officially incorporated as "The Second Reformed Presbyterian congregation in the county of Philadelphia, District of Spring Garden." That same year, Reverend Crawford purchased a piece of ground on behalf of the congregation on the northwest corner of Schuylkill Front Street (now 22nd Street) and Wood Streets, below Callowhill, to erect a church building and establish a burying ground.

At a congregational meeting of the church on September 30, 1844, "it was resolved that the trustees be authorized to make Joseph Fleming a clear title 'to the Ballance [sic] of a lot of ground,'" which was "'commonly called the Burying ground,'" as part of a deed poll (that is, a subdivision.) Burials continued through 1846, when a new church building was constructed on the site. The burying ground parcel was formally sold in 1850.

In 1885, the Second Reformed Presbyterian Church united with the Philadelphia Central Presbytery of the Presbyterian Church, under the name of the Covenant Presbyterian Church. In September 1908, it consolidated with the Olivet Presbyterian Church at 22nd and Mount Vernon Streets and the organization took the name of the Olivet-Covenant Presbyterian Church. The old Reformed Presbyterian church building became the Saint Ludwig Parochial School. It was later demolished. The site of the old church and burial ground is now Maja Park and the Parke Towne Place apartments on the Benjamin Franklin Parkway.