Let's pretend for a minute that you have a conscience and feel bad about the effects of the mistake---not just the effects of having the mistake discovered. What if you have harmed someone you cared about? Would you still apply the strategy you are advocating?

Perhaps apologies do "serve as a license for the mob to further punish". Even so, what is the result to your life or to an organization of doing what you suggest?