I think the general consensus is that the ineffectiveness of long sentences is mostly about hyperbolic discounting. Hawaii has recently had a lot of success with a program providing small, immediate penalties to people who break their parole conditions. This seems to work far better than large penalties that will only be applied after a large number of offences.