They did not give any details of the circumstances of their deaths or how many bodies were found, but local press reported two babies had died.
The bodies were found in the small town of Wallenfels in northern Bavaria.
A police spokeswoman in nearby Bayreuth refused to comment.
Criminal investigations teams and prosecutors began their investigation immediately after the discovery, with prosecutors set to release further details of the case on Friday, reported the Süddeutsche Zeitung.
Last May, a woman was sentenced to three years and eight months in prison for killing two of her children and hiding them in a freezer.
In October 2013, in Bavaria, the bodies of two babies from the 1980s were found during construction works.