You're selfish and want me to be a good neighbor who doesn't steal your women.
I'm selfish and want coke and prostitutes and your women.
Those are, at least in your point of view, mutually exclusive (I can imagine people who would appreciate a neighbor who's into coke and prostitutes).
I just don't see how one person's selfishness is better (in a rational way) than other person's selfishness.
If you're in a system with a bunch of humble rich guys, people will be forced to be thoughtful and conscientious. In a system of cocaine and no-value relationships, your daughter is seduced while you're nursing a hangover, and then you die of heart disease.
It isn't about stealing women, but rather creating a sustainable lifestyle where people grow and have a manageable environment.
On the other hand, the humble, successful businessman simply becomes a better neighbor to all of us, and probably creates an environment where our loved ones stand to benefit.