Justice systems don't operate to make people feel better or make the evil suffer.
Not giving that authority to the State means that it is retained by the People. The whole point of a justice system is to give the State a monopoly on violence: in return for giving up their right to vendetta, the People expect that the State will be scrupulous and fair in its prosecution of criminals.
Indeed, this is the foundation of the legitimacy of the State, and it is why a State which refuses to execute justice will eventually lose legitimacy in the eyes of its People.
I'd prefer the criminal justice system focus on rehabilitation rather than punishment. I'd rather we try to make society safer than exact revenge: we all have different ideas of revenge, but a safer society ought to be pretty easy to agree on.
However I find that the US system is pushing some insane punishment in a lot of cases.