This cuts both ways as you point out. People vote for all sorts of reasons, and people are willing to overlook racism because they have higher priority issues. Just because the president is a racist doesn’t necessarily make you racist for voting for him. It just means you have things you consider more important.
Having African American voters doesn’t make you somehow not a racist, and voting for a racist doesn’t necessarily make you one. That’s how far the American political system has fallen.
Mere indifference has become controversial.
That kind of ignorance is nothing compared to literally forcing migrant women to have hysterectomies along the southern border. That’s a different kind of racism. [1]
[1] https://www.npr.org/2020/09/16/913398383/whistleblower-alleg...
Who are these voters racist against?
The premise makes even less sense if you're calling out divisive rhetoric.