You are falling pray to the tolerance paradox, I'm afraid. Unlimited tolerance against the intolerant leads to the disappearance of the tolerant. Von Neumann understood these subtleties, perhaps too well, seeing where we are at today.