It's the other way around. The people making enough money to retire early also have fewer working hours.

It's people who make the least money and can't retire who work the most hours.