Usually I'd agree with you, but this arguments works as a heuristic with a 70/30 split. Maybe even 90/10, if you have some data. But when we're talking about a single woman on thousands of men in the job, personal preference is very probably not the reason.