A free society necessarily must permit some degree of what could be considered vigilantism - even if the vigilantism is intended to restrict someone or something else's freedom in some way. I'd call this the "meta-paradox of tolerance".

The difference in degree you mention is the boundary between legally (and sometimes morally) acceptable and unacceptable forms of vigilantism.