If they were enjoying a light marijuana buzz (or a light alcohol/caffeine buzz!!!) during work hours -- or in a way that directly and visibly effects their work performance -- you might have a point.
But even in those cases, I would still strongly disagree with your rationale. The same line of reasoning also justifies jailing people for obesity, which "Has Been Known To Significantly Decrease Productivity". And it certainly justifies jailing people who drink alcohol, since even mild hang-overs have rather extreme effects on productivity. If you're too over-weight or hung-over or high to work, then you should be fired. Not jailed.
But justifying a law on the basis that individuals should organize their private life choices such that they are optimally productive as members of society? That's quite the burden, and if we're going to impose that burden, I suspect we'd have a compelling justification for jailing literally anyone.
There isn't just the selection bias of people you tend to know potentially not being representative of most drug users, but the need for comparing how those same drug users would do without drugs (I'm not sure how this is possible to evaluate). It isn't enough to say that some drug users are highly motivated and successful, which I don't contest.