I believe your question is an excellent way of thinking about death. Death for each of us is as it was before we were born. In other words, death is non-existence, which is nothingness, which obviously cannot be experienced. Therefore death itself should hold no fears, and yet it does. What we fear in death is the act of dying, and being conscious of our life ending. So yes, I believe you are right; we are dead before we are born, and the only difference is, our existence has in some small way changed the world, and even the universe from which we evolved. It seems to me that because of mankind's sometimes egotistical nature, the great religions cannot come to terms with this obvious logic of nothingness after our very existence, and so they invent other outcomes of an after life, with certain attractive and very unattractive features, seemingly missing the perfect outcome, which is nothingness with no desires and no fears, the perfect peace we already seem to know.