In earlier eras the answer was it didn’t stay luxury housing, but moved down market as shinier and newer buildings kept coming online, and as overeager developers built more fancy housing than there turned out to be a market for.
Then when you have all those landlords and more housing units than are needed, there’s price pressure all the way down, and a lot of upward mobility as people slide up into slightly nicer homes, leaving a bunch of reasonable quality homes open all the way to the bottom of the market.
We haven’t had anything like free market supply of housing since the FDR era, so this example is so far removed from living memory that most people can’t even imagine it.
Usually what happens, is in order to keep the asset value high they'll sit on vacancies for as long as they possibly can to avoid having to recognize a lower value on the property, until it becomes advantageous to do so as a write down after they're done leveraging themselves based on the inflated asset price.
It sounds like something is wrong with lending if someone is willing to lend to them based on inflated asset prices!
We need housing in absolute numbers, real units to fill the very real jobs to housing imbalance of 150,000 more jobs than housing units that were added to the city over the past decade. And we need real units of subsidized housing as well for those at the very bottom of the economy. What we don’t need is feel-good percentage requirements where the denominator just ends up being close to 0.
Also, so-called luxury housing is often like ~15% more expensive than the median housing price in many areas. It’s a name that makes it easy to hate on, but like it or not it is housing for real middle and upper middle class people. The amount of hate it gets, you would think we’re talking about housing for billionaires or something.
I'm just pointing out that changes in zoning alone don't tend to work to increase affordable housing supply for already high-value, desirable areas due to the inherent market incentive for a real estate developer to try to make more money by making more expensive housing units.
No car company produces cars for people living on the minimum wage and yet a great many people living on the minimum wage can and do afford cars. Building new housing reduces the value of existing housing.
The problem with housing is a lot deeper rooted than basic Econ 101 supply & demand models can address.
Here is an article about a developer who tried to build a low income apartment building in SF, and the absolutely insane roadblocks the city put in his way https://reason.com/video/san-francisco-mission-housing-crisi...
https://leginfo.legislature.ca.gov/faces/billTextClient.xhtm...
https://sf.curbed.com/2019/5/16/18617019/transit-housing-bil...
Usually what happens is they raise or borrow a bunch of money to build much higher margin housing (e.g. hip condos instead of affordable apartments) until the market is saturated with still more unaffordable housing.
Without explicit incentive structures or requirements like, "You must build X number of affordable units for every Y number of luxury units." things tend to stay pretty broken.