I could not in good conscience say "the kids who die of preventable illness, their lives are worth it so antivax people can spread misinformation without consequence."
I could not in good conscience say "the Tutsi lives lost were worth protecting the Hutu rights to free speech."
Aside from that, both of those examples are examples where the harm comes from a specific action (or inaction), rather than the speech itself. If refusing to vaccinate children was treated as criminal neglect and unvaccinated children were forcibly removed from their families, people could talk and talk all they want and it wouldn't matter.
Like, are you trying to frame this in the sense of, "I can swing my fist toward your face all I want, but so long as I don't actually make contact it's okay"?
I'm trying to understand how you're trying to thread the needle here and am coming up empty-handed.
I mostly agree with you about Rwanda because openly calling for people to commit genocide does cross a threshold that justifies forceful reaction. My point there is that you're appealing to government, which is exactly who in Rwanda was organizing the genocide in the first place. But if you're imagining a UN peacekeeping force being deployed to Rwanda being the censors instead--sure, among many other things they should probably shut down the radio stations. I'm fine with that.
> Do you not see that there is a line drawn from speech to action
The problem is that this argument makes it too easy to misuse the instrument of censorship. You're calling for censorship that's both unnecessary and insufficient to solve the anti-vax problem, using a standard that could be just as easily abused to call for censorship that even you would disagree with.
Which people? Twenty years ago, people (by which I mean schoolteachers) baselessly believed that Columbus proved that the world was round rather than flat and disseminated that idea, and it was hard to disseminate the counter-idea of "no, actually, that's not true, the Ancient Greeks already knew the world was round, Columbus just thought the world was round and also much smaller, and he was wrong".
If you can stop people from disseminating "harmful" ideas, you have the power to decide which ideas are "harmful". You might think it's "harmful" to disseminate the idea that the American Civil War was motivated primarily by the issue of slavery, for instance. If you're just in charge of buying school textbooks for the state of Texas, you won't buy textbooks that disseminate this idea, and that's harmful enough. But if you're in charge of moderating user-generated content on a huge set of platforms like Google and Facebook are, it starts becoming more and more of a problem.