Those are actually the same problem. The wealthy can buy housing faster, more decisively than the less wealthy. They may also push out the less wealthy, simply by offering them an above market price. And as the wealthy start to buy up housing in an area, the prices start to go up, and soon become high enough that only the wealthy can buy.
It's just unrealistic for a finite resource such as a location to accommodate anybody who could possibly want to live there. That's why desirable places are expensive.
You should ask that question to the NIMBYs that have pulled the ladder up from under them.
"Nobody is allowed to move to this area after I did" is insane, toxic, and selfish.
And therein lies the problem.
And if I have to choose between people having a roof over their heads, and investors being happy, the latter can go pound sand any day of the week.