It will take state level intervention. The voting population of the city of San Francisco itself has enormously outsized influence on the regional economy due to their ability to control development within the borders of the city. But they constitute nowhere near the majority of the population of the Bay Area. At some point (ideally) their state level politicians will just get steamrolled by the representatives of the rest of the state's population, and most of their power to control local development will be stripped away.

Presumably the opposition to that won't just be Bay Area NIMBYs, but anyone living in California with an interest in the state not dictating zoning policy to local municipalities.