Plenty of societies appear to do much better than the US at preventing recidivism and reforming criminals to productive members of society.
Well, America's violent crime rate is 10 times higher than Europe's violent crime rate, so make of that what you will.
Some are cultural bits in subpopulations that are resistant to change; we can work on it, but it's not clear how much of an effect any intervention will have.
There's some other structural ones that will be extremely difficult to change-- we have the some of the most dangerous places in the world next-door in Latin America.
There are of course some people who are so dangerous, so relentlessly violent, that they can never be released from prison. Does that mean we should be brutal to those people for all the years they're in prison? Why? What's that going to achieve? It doesn't stop them being violent, and it may well escalate their dangerous harmful behaviour in prison.
I mean, you aren't going to build trust by treating people poorly.