Relationships and marriages usually lose the infatuation and start having problems 1-3 years into the relationship and/or marriage.
So you are RIGHT ON cue here.
Unfortunately, whatever problems there were before the "honeymoon" phase dies out will now become stronger. And in your case, mental illness is a very serious problem.
This is not likely to work.
I think it would be best to move out, yes.
And I think that if you ever want to have a spouse, and not be a single mother, tha you need to start divorce proceedings, so that you can become free TO look for someone.
Just don't settle with another person who is mentally ill. It is hard enough when the person isn't mentally ill.
Sure, you can stay married to him for the rest of your life ... but don't expect this marriage to work, or that you two will be able to live happily together. You are facing a life the same as a divorced woman, except you won't be able to date or marry again.