I'll add that the basis of the wording of the 13th amendment was to sweeten the deal for southern states. They had a lot of black people in prison already (and then some), and did not like the idea of undergoing reconstruction without some source of free labor.