The "paradox" of tolerance is only a paradox if you tolerate actions other than speech. If you only tolerate speech, there's no paradox - as soon as speech translates to actual harm, the hammer is brought down.