I agree with your third paragraph about the conceptual error. I think there are subtleties to the concept and racism is manifested differently. I've heard Muslim and Arab people talk about their experiences with racism and I believe them but they don't complain of the same things that happen to black people.

And yes I chose the kkk member as an obviously racist person but my point was that pointing out white privilege is just not racist.