It’s not out of “fear of maybe inconveniencing someone”, it’s out of a sense of common courtesy.

There are plenty of social events that are appropriate for this sort of interaction. Running errands or just trying to go about your day is not one of those IMO, and if dozens of people accosted you per day you’d probably feel the same way.