Then you don't accept the principle of freedom of speech because you threaten retaliation to ideas. You use a strawman that abuses that freedom to justify your response.

https://en.wikipedia.org/wiki/Freedom_of_speech

First sentence clearly states that to adhere to the principle, retaliation is not to be feared or people will not speak up. This threat of violence is prevalent in dictatorships all around the world.

But for any intellectual dialogue the adherence to freedom of speech is a minimal requirement.

There is a difference of principle and requirements de jure.