Think about this, not so long ago you didn't have any wisdom teeth back there, now they come up. What's the difference between taking them out, and them not being there before?
It could actually be a problem if you don't take it out, as it seems your mouth already don't have space and they can push on your other teeth, and cause serious problems than just the way you look.
So I'd have them taken out if your dentist recommends you do.
Common sense, Dental Assistant