That's why even the rich get more annoyed when inequality rises. They see those making more than them pulling away. The knee jerk reactions to this tend to make the problem even worse (eg. lower taxes, justified by reducing social security).