This is the paradox enabling many to blindly say Antifa is a racist or fascist organization. No, they are the intolerant side of tolerance laying down the law. Without them, any tolerant society devolves slowly to fascism.
The key is to realise that the "Antifa" agenda has nothing to do with tolerance, regardless of what they claim.
This isn't as complicated or confounding as you seem to think. The "fascists" that Antifa think they're fighting aren't attempting to overthrow the government or build armies of SS-style street thugs. They are usually just protesting, or sometimes trying to give a speech at a university.
Speech should be countered with more speech. Violence, with violence in the proportion needed to stop it.
Antifa's agenda is to use violence to suppress speech. Like a lot of self-righteous activity it is rooted in hypocrisy. Their goal is to stop people from disagreeing with their political agenda by labelling any such disagreement as "Nazi" or "fascist" and then claiming their violence is justified as otherwise they'd be "tolerating intolerance". It is doublethink.
Secondly it is a component of decision theory and yes philosophers can propose mathematical propositions that do get rigorously investigated by real mathematicians. Saying a philosopher can't do math is probably the dumbest thing I've ever heard.
Those ones who would not tolerate those with intolerant ideas, have intolerant ideas too, and they must be convinced their ideas are wrong.