Is it any weirder to believe in that than in religion? Religion is largely about magic, after all. In fact, if you're religious, you pretty much HAVE to believe in witchcraft and magic. The Bible, among other religious writings, claims they exist.
I'm an atheist, but I don't think believers in witches are any more "losers" than believers in a god.