Such rules exist. Many homes have "historic monument" status and cannot be torn down.

But you can dispute it in court. Steve Jobs spent years to win the right to tear down such a house with protection in woodside, CA. Ofc, he passed away before construction began, iirc. Coincidentally, the VP Eng. At my previous employer grew up in said house back in the sixties or seventies.