I have a Twitter and thirteen followers. Most, if not all of them, are 'follow for a follow' profiles, YouTubers just starting out, webcam porn, girls wanting 'hard sex' (seriously, I have one following me), and small musicians/bands. They don't actually look at your Twitter or what you're posting about. Heck, I post about writing, but I can easily tell you the people who follow me don't know that.
I didn't make my Twitter for follows, I made it for my own entertainment, so it doesn't bother me. The best advice I can give is to keep posting. Eventually, someone would be interested, but it might be a while if you want genuine followers.