IMHO, the Bay Area is its own kind of dystopia, with low-density 'burbia spreading like a mat over the (previously beautiful, I presume) landscape. Even things like central Santa Clara are quite low density, with wide (very wide!) streets, low houses (typically 1-2 stories) set back far from the streets with ginormous parking lots.
But e.g. having taken Caltrain from Palo Alto to SF a few times, there is plenty of room for much higher density around several of the stations without losing much of value, and in doing so you'd take a lot of pressure off both the nearby city centres and the less developed land.
I live in London and wish for the same here - instead of increasing density in areas that are already high density, pull development out of the centres, surround well connected stations, and use that to justify more services on more suburban stretches of existing rail etc.
My favourite example is that highrises going up surrounding my local train station will house as many people on ca. 2,000m^2 of land as my road of 660 houses has space for on ca. 40,000m^2 of land. And the environmental effects of less travel etc. as more of those people can rely on public transit will be enormous. Increasing density around the stations like that will reduce the need for smaller density increases across the board, or eating into greenfield sites.
It may well be it needs upgrades to be able to handle more, but even just having the land is a major part of the cost. It's certainly better than depending on trying to dump higher density housing in the middle of neighbourhoods where transport upgrades will require starting from scratch.
And if remote working continues, that'd allow far more housing near transport hubs. People will still travel on occasion, for all kinds of reasons.
And the second advantage of construction near transport hubs is that it usually means fewer neighbours likely to object. E.g. last time I was at Palo Alto at least, there was no low density housing immediately surrounding the station, and even where there is, there's typically little enough to make buying up the required properties to resolve the issues a lot easier.
Consider that the number of trains per hour for Caltrain today is a joke, and the length of the trains likewise. From a few quick searches it seems much of that is due to lack of electrification, which is apparently in progress. Complete that and you get 30%+ capacity increase without increasing train lengths, and Caltrain trains are about half the length of e.g. London commuter trains. I suspect you'd need signalling upgrades to increase the frequency much, but you probably could more than quadruple Caltrain capacity from current levels with relatively low impact works to the actual lines (finish electrification; extend platforms to handle at least 12 cars; signalling upgrades to handle a few more trains per hour) - most of the cost would be additional trains.
That gives a lot of room for additional density along the existing line before you need to justify expensive expansions.
But getting support for expansions would probably also be easier if people come to see it as a way of keeping development pressure away from their neighbourhoods and focused on the transit hubs.
But of course this « different system » is science fiction at this point, especially in the US.
Maybe the solution is not to build more residential to keep growing, but instead to limit implantation of new jobs/companies to limit the growth to a sustainable decent value? The result would be to limit real estate price, but without making the Bay Area a hellscape of concrete towers.
I understand it is controversial, but do we really want to transform the Bay Area (which still has some really fine natural beauty and neighborhoods) into the hellscape that are some Chinese (or European) concrete tower based suburbs? Do we still want to keep centralizing more?
Sadly free market + democracy means either the homeowners side are in charge and keep the status quo so their property prices go up. Or the renters side might one day win, and start sacrificing this nice place to make concrete prisons for everyone. The current system ensures that the optimal thing to do will never happen.