It really doesn't. There is a very narrow set of circumstances that would aversely affect your place in society based on how you earned it.

Just think about how often it actually comes up regarding the wealthier people you may know or have heard about. Your wealthier neighbor.

Odds are you never dug for all the civil litigation they encountered, or the relative morality behind each case or circumstance.

They are just wealthier and society will reward them for that in perpetuity with access to better housing, better schools, better healthcare, and even more capital. End of discussion.