This is exactly my experience. I almost never smoke weed, and only do when I'm in a comfortable place and among friends. Shrooms is more of a mid-level body/sensory experience for me, whereas pot is a deep dark journey into the recesses of my psyche.