You do gain something, namely you don't become the same as the people you're implying are worse than you. If everyone is on the same level, nobody is an improvement over anyone else and the contrast is a purely cosmetic one.