May I posit this is because you are rarely in situations where you feel your gender is pronounced? If you were, say, a man applying for a job as a general hospital nurse, you would feel this, or as a heterosexual hairstylist applying for a salon job. There are stereotypes you would feel pressure to justify why you, who do not fit the stereotype, would be a beneficial person to hire, in such cases.

Not defining oneself by gender or race does not invalidate the hypothesized effect: that one may feel excluded if they don't see anyone like them doing it. There is no denying that the fact of being a man or woman influences a lot of our lives and how people treat us.