It isn't. Unfortunately there is a negative perception of hedonism; a perception that a hedonist is someone who just wants to eat, drink, party, do drugs, and have promiscuous sex without concern for anyone or anything else. I'm sure this is true of some hedonists, but other hedonists are law-abiding, ethical, charitable, and compassionate.
Moreover, ask yourself what is hedonism and who is a hedonist anyway? Hedonism is simply the pursuit of sensual pleasure. And unless you're an imam or a buddhist monk or something like that, we all want to feel pleasure, whether it's from friends, family, nature, literature, art, music, sports, sex, food, alcohol or something else. There's nothing wrong with that. In fact, that's really the point of life, isn't it? We live to feel. We are all hedonists.