Density of San Francisco: 18,838/mi^2.
Density of Barcelona: 41,000/mi^2.
> encourage smart young people to move to Denver and Charlotte and Miami and Raleigh and Indianapolis and Phoenix and Burlington and Madison and
This is a failed strategy, and a bit of reflection shows why it is. Think from the perspective of Google. If Google thinks the best engineers are in the Bay Area†, Google needs to be in the Bay Area. Otherwise, the best Bay Area engineers, who have a choice in where they work by virtue of the fact that they're the best engineers, will go work for competitors. Now realize that this dynamic is true for Apple, Facebook, and even Amazon and Microsoft, and you see why the situation is the way it is. Given this, the realistic options are (1) drive everyone but the rich out of the Bay Area; (2) build more housing. So far, rich municipalities like San Francisco are choosing option (1) under the guise of "progressivism".
Besides, even if it were possible to force Google to move, it isn't fair for rich people in the Bay Area to gentrify Modesto just because they don't want to build housing.
†I'm not arguing that engineers in the Bay Area are actually better than engineers elsewhere. The point is that the big tech companies think that the best concentration of engineering talent is here, and economically, that's what matters.
You know how you get those smaller cities to be places where tech companies can grow successfully, you start now, by building infrastructure that retains the college graduates from the area, and in 10-20 years, the region has highly competent professionals in the given field.
We have an affordability crisis in Michigan because average rents are now up into the $1600/month range in many areas. Once you adjust for income, a $1600/month rent in Michigan is an effectively identical expense to a $3200/month rent in SF/NYC.
When NYC / SF / other top-tier cities chew you up it's no big deal -- cash out and move to the Midwest. But what can someone do when a Midwest or other bottom-tier cities chews them up? They're stuck, there's nowhere cheaper to move that still has any jobs.
Like, Japan famously hasn't grown in years and years and is arguably suffering from deflation. Does that affect their housing prices as much as anything else? Does anyone here have a PhD to help explain these complex multi-causal factors? Probably not
To develop a comparable economy of scale, the US would need to significantly relax zoning rules and develop national by right standards.
But yeah, everything else you said is spot on. I previously worked in commercial real estate, and I find the Matt Yglesias-types' understanding of how property development works to be bordering on magical. I mean, again, I fundamentally agree with the YIMBY movement, and that many zoning laws are glorified rent seeking. But the affordability issue is fast leaving rational discussion and entering belief system territory. Manhattan & the Bay Area & LA are expensive because the demand to live there is 10,000x or 20,000x what it is to live in, say, Milwaukee. This is the root of the problem- you cannot possibly build enough to sate demand in a non-command economy