Your argument boils down to "I agree with one cause and reject a caricature of the other, so the first should be allowed". Not agreeing with something is not a reason to ban it.