> enough to turn him in to a racist
If I were to call you a sexist for your choice of pronouns (and throw in "self hate is the worst kind" if your pronouns happen to be he/him), and you were to see several other likely unwarranted accusations being thrown around against you and others, you'd be less likely to take notice when real sexism is called out. Fewer people taking notice of real actionable cases of sexism would likely result in more sexism over time.
From that premise we can proceed to the idea that "racists" act on those impulses, while people who are "not racist" resist them. However, these impulses can be extremely subtle, and no matter how we struggle, I don't believe that that any human being lives a life avoiding racist acts entirely.
Would you still argue that I'm a racist perpetuating a false claim as an excuse for my own racism? I mean, I accept that I'm prejudiced and every once in a while racist despite my best efforts, so that part is true in a sense. I'm don't think I'm trying to excuse myself, though.
So, wait, you're saying if someone who's not a racist gets called a racist that's going to be enough to turn him in to a racist?
If that's all it took they were probably racist to begin with.