I guess you don't believe that with great power comes great responsibility. It seems to me that line of thinking that having control over other peoples lives doesn't require responsibility. That is the real problem here.

Judges, police, politicians all are very different from those of us not giving the power over others lives. You should expect them to behave accordingly or expect that they be locked away in prison or executed. Just like they do to other people often times wrongfully.