It is zero sum over the entire Earth, but not as zero sum as you think, locally in one country - It's quite possible for any middle class man with a decent job to travel to a less affluent country and marry a very attractive wife they would want.

You have to share the piece of your pie your country has, but nothing is stopping you from grabbing at another country's piece of the pie.