The US was ostensibly formed to preserve the rights of its citizens. If we let people exercise those rights, they may dissolve the union. But if we don't let them exercise those rights in order to preserve the union, the union loses its entire purpose; the union as it was intended is destroyed just as surely as if it were dissolved.
It wasn't so clean cut back in Germany in the 30s either, there was always some other rhetoric: being "stabbed in the back" in WW1 by internal forces, using emergency powers to deal with effects of Great Depression and threat of Marxism.
[Update]
I encourage watching snippets of Hitler's speeches (with translations): https://www.youtube.com/watch?v=AnpTWKKWQ1o. Strip away swastikas and heils and these could be used by populist politicians today.
Even if we succeed in prosecuting hate speech there will still be plenty room for fanatics to come to power.
Well, the CPUSA wasn't.
Nazi's are an easy target. The problem starts when things are not as clean cut -- when actual politics are involved, as opposed to crude stuff like "exterminate all jews" and "blacks are inferior", etc that Nazi's might say.
Let's say a team wants to overthrow the presidency and bring something like another parliamentary system in the US. Or rewrite the constitution and remove the BS ideas from 3 centuries ago.
Should they be allowed to express their ideas? If they get somewhat popular and other people worry about their influence?
And what's stopping disagreeing people from considering them the same, or worse, as they'd have more current influence, than Nazis, and asking to ban their speeches etc?
(Many people considered the CPUSA like that in the 30s and up to the 60s)