Rich people will get poorer in the part of their wealth that is largely virtual anyway - stocks and other investments, the value of which is so far removed from the real world by now, it's all just make-believe. The actual physical assets that provide them with improved quality of life will be just fine, for long enough that all those virtual losses become gains.

But the poor and the middle class will be hit - are being hit already - at those physical assets. So their quality of life plummets directly and immediately.