I think you can get people to agree to other mandates of the justice system beyond pure punishment as deterrent if your other mandate is more specific, detailed, and limited than "rehabilitation". For instance, lowering remission rates, or keeping employment rates pre and post prison similar...
For some people, "rehabilitation" that does not involve serious medical intervention not currently possible is just not going to solve the problem. No amount of disincentives or will power or whatever is going to help someone behave better if they are literally brain damaged.
Do you really believe that only those types of prisoners end up in solitary confinement?
I also think that it's well evidenced that solitary makes people go completely insane, and that the guard doesn't care very much what happens to them if they ever get out of prison.
EDIT: What I'm trying to say here is that I think what we're doing is harmful, but there seems to be little incentive for empowered parties to change it.
Belief in a Just World creates an unjust one.
It seems like many or most Americans believe that the proper mandate of justice system should only include punishment because:
1) rehabilitation is immoral because it would tend to reward and promote wrong doing
2) prisoners are morally inferior and therefore rehabilitation will be ineffective
3) moral and orderly persons needn't fear the justice system because they won't break the law and therefore
4) arguments for reform must be rooted in concern for the welfare of morally inferior persons, because reform can have no other utility
I have heard these things from many people I know, and apparently most of us voted for the system we have. Also, I think we really enjoy punishing people, even if it's abstract, it's very satisfying to imagine dominating and tormenting people we don't like, and along with appeals to fear, this is an excellent way to appeal politically to citizens in order to forward one's interests.
I really can't imagine that we will stop doing this as long as only a minority of people are concerned about being imprisoned themselves.