I don't think that any system that has something you can find objectionable about it would mean you should ban a group.

There is a difference between groups with some questionable beliefs about others, and those whose groups are entirely about hating other people.

That's a reasonable answer, but note that's it's a different answer from the OP - you're not proposing to ban intolerance per se, but rather any group whose purpose is solely intolerance.