That comic (and accompanying article) make a good point. It's easy to see how annoying (or scary) that would be. Though I would say the men depicted are total douche bags. I won't defend them. I will defend the guy who likes to say hi to you in the cafe every morning, or the co-worker who buys you snacks when you work late, etc.
If being called out on my looks was an exceptional thing, it would be less annoying. Heck, I was harassed on my way into this Mountain View coffee shop just now. I just want to study data mining...