What is the best way to remove torx security screws?

I have the right sized torx bit but the knob in the center prevents me from using it. I have had no luck using a flathead, is there any way to grind down the knob somehow or what am I supposed to do?
14 answers 14