2 things: 1. Just because you're not confronted with racism daily doesn't mean it doesn't happen. Boston is considered one of the most racist cities in the US, because once per sports game they scream the n-word at a black person. I'm like 99% certain I've heard similar stories in European countries.

2. The second part of your analogy is the "I know a black guy" trope that happens in the US. It's a pretty common thing, and no one believes people are 'not racist' just because they 'know a black guy'.