Is it okay to keep a spare car battery sitting around?

I don't have a specific car or battery to question about, but would it be bad to carry a spare battery around just in case the current battery goes out? Would having the battery sit for a long time cause it to deteriorate?
9 answers 9