You are completely forgetting about voluntary restrictions on land use via mechanisms like Homeowners' Associations. Want to enforce setback on your new development? Fine. But how do you know that setback is what everyone in the whole city needs?