You usually only notice people when they do something weird-- maybe 999 days out of 1000 that neighbor is perfectly normal, but on that one day they were having an off day. That's the day you notice them.

An advantage of living further from people is that just fewer interactions with strangers and near-strangers so fewer opportunities to be the victim of someone's off-day.

One came up to our back door ranting and screaming, and my dad had to tell him to fuck off.