Yes, it is on you. If you find yourself in such an absolutist situation, you can bet money that you are in the wrong. It doesn't help that you have grouped all these "evil" and "dumb" opinions under the umbrella of "anti free-speech". That's an absurd exaggeration. Of course an opinion that is "anti free-speech" without any qualification would be dumb or evil.
That's an interesting spin on "people have limited tolerance of free speech, when that speech is flagrantly intolerant." The argument is that tangible and quantifiable harm can arise from certain utterances. Such speech is not "wrong" per se, but a violation of the principle that your right to swing your fist ends where my nose begins.
Yes, people are intolerant of all sorts of speech and expression which are perfectly harmless and protected speech. E.g. gay people kissing in a movie is "not family friendly" whereas straight people kissing is downright expected. Or, people being harrassed for wearing their symbols of faith in public, etc. That's speech and expression that aren't harmful, though they do offend bigots -- there's no demonstrable harm in those expressions, and the offended can piss right off. (edit: harrassing is not free speech; wearing symbols of faith is)
What I was referring to as intolerance is hate speech. Calling for violence, denegrating a class of people, etc. There, real and demonstrable harm is done.
You "debunked" the least generous interpretation of my statement, and thereby completely avoided the point.
If a well funded group of people are publishing information about a minority group in order to incite and justify genocide, like what we have seen happen on Facebook in Myanmar, I think the rights of the people being massacred should trump the rights of the genocidal's free speech.
Is that argument dumb or evil?
As a pro-free-speech advocate, I think that argument is important and smart and good.
Free speech does have disadvantages, and those disadvantages can have serious consequences.
The attempt to hand-wave those disadvantages away with "but enough people will just be perfectly rational and care about truth, and then all those good people who love truth will prevent genocide!" is... extraordinarily naive.
Whether to support free speech is a question of weighing advantages and disadvantages. I happen to think the advantages far outweigh the disadvantages. But if you seriously can't see any of the disadvantages, and can't empathize with a person who reasons that those disadvantages outweigh the advantages, then you're probably not thinking clearly enough.