Why do people consider libertarians selfish?

I don't want any of your money. I don't want to force you to do anything. On the other hand, if I choose to help somebody, I will.

How is that selfish?
Update: water_skipper

what does that have to do with libertarians?
19 answers 19