I'd argue that, especially given the social history of how the prohibitions came to be, that it's the other way round: condemning 'vice' starts out as a pretext for social exclusion and blaming the poor for their condition. We don't want to help so we set up a situation where we don't have to.

Nobody suggests testing the financial services industry for performance-enhancing drugs, for example.