Without the threat of punishment, society would collapse. There are people out there who enjoy killing, torturing, raping and destroying other people. You would need to be heavily armed to go anywhere without risking your life. Without basic trust in each other (enforced by the threat of punishment) society doesn’t work.