Both men and women should care, in detail, about their aesthetics when at work. They should be healthy and fit, and, unless they are very sure they have the fashion sense to get away with interesting clothes, be conservatively and neatly dressed. Anything less smacks of imcompetence, poor organisation skills, lack of respect for others (who do have to suffer looking at you), and laziness.
But I think we're talking more about attitude and mindset than actual looks.
If I suffer when I speak with people that don't agree with my beliefs - is it good enough reason for them to convert to my beliefs? How is it different than requiring people to respect you esthetical sense by complying with it?
If you carefully design your aesthetic, even if it does not fit with my personal style preferences, then that will be fine. Just show that you thought about it ;)
I'll just leave that there. (Not saying I agree with it completely -- but she partly has a point)