Nightmares were the worst part for me. Cannabis prevented me from really dreaming for several years so every dream was super vivid for the first few weeks after I stopped smoking.

That and learning to enjoy things sober again. Movies/tv shows are harder to pay attention to when not high. The first few weeks they were painfully boring.