To continue the metaphor, the table stakes at the tables that provide the big payoffs require the average person to go "all-in".

Whereas a billionaire usually gambles on the margins of their wealth. They definitely don't gamble with the roof over their head or their next meal, or their childrens' security. They can make any non-ergodic game appear ergodic for longer since they can survive many losing hands for far longer than others.