Yes, this is where the other shoe drops. We somehow need to trust that the "rules" our society has agreed on for punishment of breaking societal norms are adequate to prevent people from breaking the rules more than once.

We then enter into the realms of how to deal with perpetrators. Isolation vs. rehabilitation vs. eradication.

I prefer rehabilitation over isolation, and both over eradication.

This is one of the roles of government, and thus we enter a whole new world of discussion.