I justify it like this: a world where well-being is decided by wealth is unjust and undesirable, so trying to enjoy your privilege is a moral wrongdoing because it very directly prevents the spreading-out of wellbeing. This makes it equivalent to the littering problem (in mode, not scale), where I chose to kill the litterer.

I'm not confident, but that's how I rationalize it. I'd love to hear any thoughts on this.