The cemetery is located on the north side of Nelson Road and the south side of Main Street about 300 feet northwest of the junction of the two roads.

The cemetery is located in Randolph Township in Ohio County, Indiana.

Indiana Cemetery Locations, Volume 2, published by the Indiana Genealogical Society (01 April 2006), gives the primary cemetery name as German Cemetery.

In 1975 the "German" Cemetery was added to the Rising Sun Cemetery Association which consists of the following cemeteries, Fulton, Cedar Hedge and Rising Sun New. The German Cemetery was originally created by the Reform Church with a German congregation. When the German Cemetery was added to the association the records were added to the Rising Sun New Cemetery and maintenance was taken over my the superintendent. The records had there location in the cemetery designated as "G" and "H".

On the 16th day of November, 1873, the congregation of the First Evangelical Reformed Church of Rising Sun decided to purchase a "God's Acre", and in due time they secured the strip of ground now known as the German Cemetery. The congregation of the First Evangelical Reformed Church of Rising Sun cared for and maintained the cemetery until they were not able to continue doing so, at which point they contacted the Rising Sun Cemetery Association to ask them to consider assuming those privileges. On the 23rd

day of March, 1964, at a Rising Sun Cemetery Association Board meeting, the board voted and accepted a resolution to assume the management and control of the German Cemetery, along with it's equipment and trust fund. As of the 31st day of March, 2014, there are approximately 505 people buried in this cemetery at this point.