There's a few sides. Sometimes giving the moderator too much power means they also have too much power of abstention. If they selectively don't enforce rules, toxic behaviour can be enabled. Worse when rules are enforced against one participant but not another. Sometimes vague rules get arbitrarily used against the unpopular.