Sort of, because newborns have no belief in God or anything unless taught or influenced during growth. They have no idea on "what is a god?" or even "what is atheism?", because their basic minds only care about survival.
So do, for instance, feral children because no one has taught them about anything, including religion. They do not necessarily profess "there is no god" (or even know how to say it), but the very concept of spirituality does not exist in their minds, only survival. They also do not even know that they are technically "atheists" in the sense that they have virtually no spiritual belief.
Perhaps we should consider atheism as "the natural state of people", especially the one that is like "what is a god?" or "what is atheism?", should we?