These problems are greatly reduced in places with larger scale control of the zoning laws and in many of those places you also end up with lovely, highly diverse cities as well. Given good governance, neighborhoods and areas can be designated for various "character" initiatives as well and you end up with lovely places like Tokyo, Kyoto, Seoul and so on.
Not having this kind of larger scale vision is why it takes an hour to cross over a single river from West New York to Manhattan or from McLean, VA to Seneca, MD and 5-10 minutes to cross the river in Seoul from Gangnam to Geumho or between two points on the Sumida in Tokyo in 5-10 minutes.
> have the rightThe local city councils respond to lobbying on the part of wealthy landlords by 1) zoning density restrictions, 2) overregulation and amount of red tape needed for approvals, and 3) overuse of historic landmark status.
Harvard Economist Edward Glaeser has written extensively about these problems. For example: Build Big Bill http://www.nydailynews.com/opinion/build-big-bill-article-1....
See also: 40 Percent of the Buildings in Manhattan Could Not Be Built Today https://www.nytimes.com/interactive/2016/05/19/upshot/forty-...
The solution is to use the one in used by Japan which is to have the federal government override the "rent-seeking" local city councils. The honest truth is that these city councils make renters and younger people pay far, far more for housing while giving Donald Trump and his fellow wealthy landlords far, far more money than their costs.
I think the only problem with adopting Japan's model is we are so established with the current one.
I like the option of looking at how/why entrenched landowners control those communities. If the city councils were more broadly representative, that might solve the problem.
If anything, New York City is the poster child for too-centralized regulation. Why are the codes not far more locally governed? Who knows.