There are reasons to have some kind of building rules. Noice, smell and shade are valid reasons to limit certain types of buildings (or activities within those buildings).