One may give up right to be treated in a civil manner by you. That part's fine. You don't need to be civil towards people who are repugnant.

But it still does not give you justification for violence or threats. No, you are not "driven" to violence. If you are violent, violence is your decision for which you are responsible.

(We are not talking about self defense situation, we're talking about going to someone else's non-violent demonstration to stop it by force).