"Common opinion dictates that we need the state to take care of public health; thus, in common opinion, public health is an issue of crime and punishment."

Your logic is incorrect. The vast majority of the time in fact, public health is absolutely not an issue of crime and punishment.