To me, the point is that the claim "drugs are bad for society" is a problematic claim. Both from the standpoint that the word "drugs" is poorly defined when in reality there exists a broad spectrum of drugs/effects, and because to your point, the experience of using these drugs is subjective/varied, and can't be considered universally "good" or "bad".