If you have a person with $2 billion dollars, and then 1000 people with $100,000, they have an average wealth of $2.1 million, but the average really fails to capture the dynamic.

This should hold for males, and I can see it making the number of gametes relevant. Historically, 80% of women and 40% of men have reproduced. In terms of reproduction, a woman could have maybe 20 children if they usually had twins or something. If a male wins big, like Genghis Khan, they might literally manage thousands.

I mean, it really doesn't seem like a stretch to see different selection pressures on males and the Y chromosome.