Not necessarily wrong, but with all due respect this comes across as a bit selfish.
Your boyfriend has two family members who are in difficult circumstances. A parent in a nursing home is a very emotionally draining experience, and it sounds like his sister is going through this with the additional stress of being a single mom. I respect that the two of you need your together time... but it it sounds like your bf is burning the candle at both ends. And maybe he is subconsciously relying on your strength and independence while he works through this.
In terms of how you go forward, my best recommendation are the 5 P's. Prior Planning Prevents Poor Performance. Maybe you ask to go along to the nursing home. It might not be fun, but it's together time. Maybe if that's not possible, you start doing what you can to make evenings special. Make a home cooked dinner, plan a night at the early movies, go out for a cup of coffee.
It sounds like time together is your love language...