If you use a mouse with a ball on a desk surface without a mousepad, will it damage the mouse?

One of my bosses has accused me of damaging a mouse by using it on a desk surface without a mousepad. Is there any truth to this at all? I've never heard of that before.
16 answers 16