Ah I misread your first line. I don't think many people, white or otherwise feel tarnished by the banning of literal race discrimination such as white supremacy, which probably contributed to my misreading.

I figured you were referring to banning it even in the way that white supremacists currently exist (ie noisy bigots who would get in legal trouble if they actually discriminated in a meaningful way), which I think more people would oppose on principle.