Perhaps it should be, but the courts have not agreed. See Pena v. Los Angeles for an example of an appellate case that rejected this argument. It found that a "police power" exception to the takings clause applies in such cases.