This seems like a debate over semantics to me. Silence doesn't mean violence, but silence can enable violence or be worse than violence if the consequence of staying silent are worse than those of violence:
http://www.openculture.com/2016/03/edmund-burkeon-in-action....
You could debate what the morally correct thing is or isn’t if you want, but you can’t debate that you committed an act of violence.