Many people tell me I don't seem like a programmer, and quite a few are surprised to discover I went to college or do non-manual labor. There is just something about my personality that suggests to people I'm not a knowledge worker, unless the topic comes up in conversation.

They have heuristics, priors and reasoning which lead them to correct results most of the time. Maybe they are even irrational and have a sucky predictor.

I know how I feel about this - meh.

Incidentally, why do you feel that being found attractive is a problem? And is this also a problem in fields with 50% women?