Yes, it's a social contract that must be destroyed. Otherwise we will experience economic ruin. Look at what happened in Japan in the 1980s, or is happening in New Zealand in Canada. The fact of the matter is that this social contract is pure rent-seeking, and never should have been allowed in the first place. It is theft from future generations by present day homeowners.

Also it certainly is not true for all homeowners btw, lots of municipalities have fairly minimal zoning laws.