It's not always that they won't admit it. Most guys actually don't know when a guy is handsome.
A couple years back, I had the same problem. And to me, all guys (expect the really obvious bad looking ones) were the same and every one pretty much had the same level of good looks.
I wondered why this was and came to a conclusion:
You females spend hours staring at other women, getting jealous at them, comparing yourself to them, looking at magazines, etc. That's you know when a girl is physically attractive or not. You females are simply obsessed with other girls' image.