The current axiom is that yes, anybody can have prejudiced views about anybody else. Sure, and it's perfectly fine and normal to feel hurt when you are getting the hit from it. But the way progressives talk about racism today is that racism is prejudice + power structures. You can be hated all day long for being a white person, but until people of color are pulling all the invisible power structures, it doesn't really go farther than that. This doesn't invalidate that people hurled terrible insults at you, but there are not any vast structures in place to systemically keep you down as a result of these prejudices.