The source of the problem is that people started buying homes as investments, overpaying for them because there was insufficient supply, and now that they've got a mortgage and they don't want to end up underwater, so they have to make sure everybody else overpays too.
Probably the solution is inflation. Build more housing and at the same time print more money. Then real housing prices go down while nominal housing prices stay the same, so your house doesn't "lose value" compared to your mortgage but housing still becomes more affordable for new buyers. This would also help by devaluing everyone's student loans and other debt. Call it the banks' punishment for 2008.
And the government can use the new money in place of normal tax revenue, which helps the economy.
It's possible to go too far and have hyperinflation. It becomes problematic if prices double every day and nobody will accept your money because it will have lost half its value by the time they get to the bank, as is often the case in failing or mismanaged countries. But if we had e.g. ten percent inflation per year for several years, the effects would be a rather large net positive. It's basically a wealth transfer from lenders to borrowers, where "borrowers" means the taxpayer (national debt), people with student loans or car loans or credit card debt, etc. And homeowners with mortgages, canceling the reduction in housing prices that would otherwise come from significantly increasing the housing stock.
This is not to say it is a complete or normative defense of NIMBYism, but rather that a lot of knee-jerk SJW sort of reaction is missing the point and failing to address, or even really attempt to understand, where NIMBYs are coming from.
Part of me wonders if this could be solved by tech, particularly insurance products that offer homeowners protection against the variety of ways that seemingly-great expansion projects can go wrong. I'd enjoy working on that sort of problem, except that so much of the current interest in this entire topic is political, and politicians have some incentive to maintain zoning-like systems because it offers them (the politicians) great opportunities for rent seeking, by being the gatekeepers of an approval process that should instead be more straightforward and just hedged by homeowners in the form of custom insurance products.
[0] "Why are there NIMBYs?" William Fischel, < https://www.dartmouth.edu/~wfischel/Papers/00-04.PDF >