If the people don't want to provide things to folks imprisoned, the state should look into ways to keep folks from being imprisoned. It won't stop all of it - but at that point, prison is more of a public service.

Change laws and punishments so that fewer crimes result in jail time or removal from the workforce, for example. Especially for non-violent crimes. Improve conditions for poor folks, the mentally ill, and so on.