Sure, I think that's fair, yet a restriction on freedom of speech, which doesn't have to be inherently bad.

Going with the same kind of example: society agrees that murder, thievery and lying are bad things, yet find it justifiable to kill in self-defense, to steal in order to eat, and to lie in certain situations.

I'll also say that it's very different to limit a certain type of speech than to limit speech you disagree with.