They did not give any details of the circumstances of their deaths or how many bodies were found, but local press reported two babies had died.
A police spokeswoman in Bayreuth, a town in the north of Bavaria, refused to comment.
Last May, a woman was sentenced to three years and eight months in prison for killing two of her children and hiding them in a freezer.
In October 2013, in Bavaria, the bodies of two babies from the 1980s were found during construction works.