I can't answer the philosophical/ethical question, but on the legal side, if this is considered a kind of "zoning" (prohibiting commercial use of residentially-zoned property), it's long established that that's a permitted kind of regulation: http://en.wikipedia.org/wiki/Euclid_v._Ambler