There is nothing paradoxical about tolerating all speech but not tolerating any violence. (Both of those are extreme positions, though, which I don't necessarily advocate).