This occurred to many people some time ago and subsequently it's been shown that while this is surely a factor in some instances it is not true in the main. Biological differences probabilistically motivate preferences.