I think you've mistaken moral for legal. We don't punish immorality except through social and cultural pressure, or to make it a legal issue, and then we aren't punishing morality so much as legality (even if rooted in morality).