I don't think it matters. Do you? Abusive people who are enabled by their privilege need to have that privilege restricted. I believe they deserve such restriction as a form of punishment, a moral consequence of their abusive behavior. But even if you reject that moral analysis—and there are reasonable arguments for doing so—putting or keeping abusive people in power harms the community, and keeping community members from being harmed by an abusive person is more than enough justification for restricting the privilege of that person.

If by "cancel culture" you mean, as is often the case, "bad actions having consequences", then yes.