My point is that freedom of speech is crucial to a great intellectual environment, and that you can't have freedom of speech and ban the discussion of vast swathes of theories about the world.

You claim that this is just something that people who enjoy racist and misogynistic jokes say. That is absurd. Noam Chomsky, Norman Finkelstein, John Stuart Mill, etc. - are these people all just racists and misogynists? Norman Finkelstein, when he says that Holocaust denialism should be taught in college by Holocaust denialists - is that because he just wants to be able to make jokes about the Holocaust?