Joseph was also married to Lena DUFFINA, her first husband's last name was CARPENTIER. She is buried with her first husband at St Lawrence Cemetery. Joseph married Lena after Anna Maria died.

Jordan Independent Newspaper December 1918
JOSEPH BALTES DIES AT HOME IN ST. PAUL
"Was Prominent Citizen of New Market For Many Years in Business" A prominent citizen of New Market was gathered to his father's when Joseph Baltes died at his home in St. Paul on Dec. 3. His funeral according to present day regulations, was held at New Market last Friday forenoon at 10 o'clock. Father Sullivan of Lakeville officiated at the cemetery rites and read a requiem after the burial.
Mr. Baltes was born in Eutilhoven, Germany, in 1846. When he was nine, his parents came to Kenosha, Wis.. Six years later they came to New Market and settled on a farm near the village. During the Civil War, at the age of 18 he was called to his country's service and when he returned he married Mary Brost of Lakeville. Their children numbered twelve, of whom six are living, Mrs. PJ Welter, Mrs. PJ Wagner, Mrs. John Seuer, Mrs. Nick Ackerman, Mrs. JP Zweber of New Leipzig, ND, and Joseph N. Baltes of Farmington.
Mrs. Baltes preceded her husband to the grave nine years ago. He is survived by three sisters, Mrs. Peter Mies of St. Paul, Mrs. John Ring of Shakopee and Mrs. Peter Wagner of New Market.
From 1873 to 1896, Mr. Baltes was engaged in business in New Market. He was progressive and became well known throughout the county. Then he retired from the store business and was New Market's postmaster for ten years. In 1911 he removed to Portland, Oregon and was married there to Mrs. Lena Carpentier, who survives him. After a residence of five years there, the couple returned to St. Paul, that being the family home since.
Those from other places who attended the funeral included, Mr. & Mrs. Tautges, Mr. & Mrs. Peter Karp, Jos. Siep and Mrs. Anton Welter of St. Paul; Olive Tetrult and Mr. & Mrs. Peter Karp of Faribault; Mr. & Mrs. B. Brost of Lakeville; John P. Ring and daughter, Jos. Ring and wife; and Anton Ring and son Harold of Shakopee.
1890 New Market Veterans census -
Joseph Baltes Co. D. 1st. Minnesota Heavy Artllery.