I suspect that if prisoners are meaningfully unenslaved (ie, enjoy basic rights to body, fair wages, etc) that the system will suddenly realize that drugs aren't so bad after all.

As I matter of legislative priority, however, I think it makes sense to work in the direction direction, ie, to work toward ending drug prohibition with an aim to making a substantial dent in what slavery remains in the USA.