> Zoning regulations aren't usually arbitrary
True, in many cases they were designed to keep out undesirables, like people who are poor, or non-white. That's not arbitrary, it's intentionally bigoted.
Nobody's suggesting dumping factories into residential areas, or relaxing basic safety standards. That type of zoning is absolutely fine.
The biggest reason is political, that people have NIMBY tendencies: yes there needs to be more housing somewhere, but put it somewhere else please. I don't want to have to worry about parking or see unsightly apartments on my block.
I don't dispute that infrastructure is a concern, but it's not a blocker. Cities growing quickly isn't some unfathomable phenomenon of the 21st century, the logistics can be handled if people want it politically.
There's so much economic development that could happen if we simply allowed builders to build the housing that people so desperately need. its win win.
By definition new apartments in a less dense area will have to stand out and the transitioning will result in either clashing. The alternative is they do it in a big wave and say buy out a small neighborhood cul de sac and turn them into apartments. It wouldn't clash any more even if they went with something downright garish but the big changes like that also upset people as they find it jarring.
Are they really in denial though, I mean many want the housing prices to go up because it means their housing ( asset ) increases as well. So there is clearly a conflict of interest.
There's definitely a grouping of people who just think adding more housing doesn't help lower prices.
Thay aren't shocked, as you say its a predictable side effect. That's why cities have to be careful when saying yes please to the economic growth promised by big companies - it can have a detrimental effects on the people living there. Zoning regulations aren't usually arbitrary (I can't speak for any particular city's ordinances) they are there to ensure that minimum housing standards are met, that people don't find themselves living too close to heavy industrial areas, that the infrastructure and green space can cope.