I don't know every detail on your relationship, so I can't give you a real answer, just an opinion. I've had two serious relationships in my life. A bad one and a great one (which I'm currently in). I have bad anxiety that keeps me up at night (which is why I'm currently answering your question). In my not good relationship, my boyfriend got frustrated every time I had a panic attack and would tell me i needed to get over my issues, and never involved me in anything. My current boyfriend does everything for me. If I'm awake at night and I turn the light on, he'll wake up with me to make sure I'm ok and try to stay up with me, all though it's gotten to the point where I'll just tell him to go back to bed.
In my experience, I'd say you need too look for someone to give you the time, love and respect you deserve. Anxiety is such a frightening thing and you need support, not someone like your bf.