That's a good point, but I don't concede that improving fairness makes the quality of life worse for the 0.001%. Their wealth far exceeds their ability to consume it. With a small shift, you can drastically reduce suffering without effecting their life in any perceptible way.