Occasional drug use is not a huge problem.

People get addicted to drugs mainly because they self-medicate for anxiety or depression, that's what you should really worry about actually, concerning your children.