"But people have to live somewhere, and places have governments, and governments may not like some people. "

Which is a reason I like the idea of federalism with much more power on the base. Basically, small, but connected states, so chances are higher, the local government represents the local people.