In contrary, the gap is non-existent. If I touch you, without even really hurting you, you can sue me and the police can arrest me. That is the extent that violence (actual violence) is discouraged in our society.

So you can hardly argue that speech is actually hurtful and that you shouldn't be punished for it.