Actually it does, because it's about power. For example, if somebody has enough money to easily pay other people to attack you, you are worse off then if that person and all his wealth didn't exist.

Too much wealth also means using more of limited resources (like land), being able to influence laws and escaping justice.