Violence has always extended beyond pure physical force. Calling someone a slur to their face, or spitting in their food, or defacing their clothes or home (especially with hateful symbols) would be recognized as forms of violence at many times in history way before modern times. Holding someone at knife or gun point is also very clearly a violent act.