We let literal Nazis March in Skokie, the world did not end. Tolerance except for those one thinks are immoral beyond reason is gives just as much license for, say, an anti-abortion activists who genuinely sees abortion as murder to remove people who support abortion.