And presumably, if having been denied justice I pursue revenge instead, I can barge into his home and beat him up, as he did to me, and avoid punishment for the same reason?

While I admire your devotion to Blackstone's Ratio, this doesn't seem like a recipe for stability and rule of law to me.