When the problem is the induced experience, the literal glyphs or soundwaves that do this are relevant precisely because they are what currently induces the mental experiences; that the words and symbols are themselves arbitrarily mapped to the meanings they induce, does not change what they in fact currently do induce.

If I were to point to some misbehaving members of some group today and say they were "naughty", this would not induce the same experience as it would have in Shakespeare's time, where that word meant "worthless". One can object to the latter and not the former, precisely because which word pulls the metaphorical lever on which mental experience, changes between those situations.

The question "is moderating such language is a good idea or not?" is a separate one to this.