> the more you care about "I don't want the wrong people living next to me"

Then, by some modern definition, you are a nazi and a bigot.