I don't think it's exactly racism in many of these cases, so much as a lack of empathy. If you're not personally affected by these terms, and you're not able to empathize with those that are, I can see why, without being overtly racist against any particular group of people, you could be against these changes.

Our inability to empathize, or "put ourselves in someone else's shoes" is at the root of so many of our problems...