That's quite right. Stress can be extremely harmful, but it's very hard for one to realize it.
I've have issues with teeth, hair, sleep, and colon all due to stress at some points (once in my life, all four at the same time).
Smoking a joint merely to relieve stress every once in a while would probably have helped my health more that it would have damaged it
Also a bit of alcohol can relieve stress, it's probably better to smooth out things a bit with a glass of wine rather than going zero-tolerance on some substance and suffering regular anxiety.