https://www.theguardian.com/sustainable-business/disposable-...
And I don't write that as a fingers-in-ears, market-will-solve-all-problems libertarian, but as a fairly left-wing guy.
There's a project at my former company that will redevelop a part of downtown SF. There was a massive back and forth and iterations that had to be done because the numbers guy at the real estate development company wanted to cut out all residential since commercial would be more profitable.
Those are the people you have to incentivize to make it work.
And anyone who wants to live in a 250 square foot apartment and get stuffed (literally!) into a subway every day to get to work is free to move there. But the people who find SV desirable move there in no small measure because it's not like Tokyo.
Tokyo added more housing than the entire state of California:
https://www.vox.com/2016/8/8/12390048/san-francisco-housing-...
And as someone who lived in Europe for a while, I think we've had the technology to house a fair number of people in desirable area for several hundred years. It's the political will that's lacking.