My impression from the UK, which seems to have a similar housing shortage and restrictive zoning laws, is that there is another piece to this jigsaw, namely infrastructure.

There are a fair few housing developments in the UK which provide the quantity and density needed, but eg don't have sufficient roads to support the increased traffic, causing gridlocks. Similar story for schools or shops.