Nah, he's not depressed. This guy wants all the benefits of a relationship, but without the actual relationship, and ONLY on his terms. He wants to have sex and hang out, but only if he gets to call the shots, and he doesn't want you to have a voice AT ALL in it. Which is why he gets angry when you suggest hanging out. He wants to keep you at arm's length so that you won't try to pressure him into an actual relationship. In layman's terms: You're being used! BIG time!
I know it's confusing because of the things he says and does; it SEEMS like he cares, but then he just up and acts like he doesn't. That's because he DOESN'T. If he wanted to be in a relationship and be committed to you, then he wouldn't be acting like a jerk - plain and simple. Guys don't get "confused".
He's right about one thing, though: You absolutely DO deserve better (though he's only saying that so you'll think he cares about you and will be more willing to have sex with him again). Personally, I think you should call him up and tell him that he's been a real prick to you and that you're done taking his crap...then hang up in his face and neevr talk to him again. Period. You DO deserve better!