Drug use is a moral failing, it sounds like you just don't like the morality. Morals are not necessarily what is convenient or fun or pleasurable.

In some interpretations, moderate use is not a moral failing, but heavy or compulsive use is.

All that applies to alcohol as well, so I agree if we're going say that alcohol is legal, then other drugs used in similar ways should be legal as well.