The person doesn't leave prison ready to productively reenter society, they leave prison indoctrinated into prison culture.
If you made a programming error at work, and instead of someone spending time to teach you how you ended up making that mistake, and working to give you the knowledge and tools to not make it again. But instead made you stand in a corner for a fixed duration of time, it would be illogical to assume you would be a better programmer after standing in the corner, its the same with the US prison system.
Society decides that their crimes earns them X years of punishment. After they've done their X years, there should be no need to punish them more. I sympathize with the victims of the convict's crimes which depending on the crime, no value of X would suffice. But we are all human, and sometimes showing a shred of compassion is what motivates the real reform.
If they are still dangerous after serving their time, then they should be held in prison longer.