People with wealth don't have more leisure time because from my experience all their time is spent working to ensure their wealth doesn't dissipate. Furthermore, once you reach a level a certain level of wealth then you want more power.