At least a few studies disagree with you about adult onset, and it does appear that adolescent use amplifies the effects, but is not the only factor:
https://jamanetwork.com/journals/jamainternalmedicine/fullar...
https://www.nature.com/articles/tp2015201
https://www.sciencedirect.com/science/article/pii/S2352250X2...
The last one is a review article.
The first study there shows some evidence of performance decline after cessation, but they do not eliminate adolescent users. The second study was unable to distinguish brain structure for users that had ceased consumption from normal brains.
I definitely was not trying to suggest that there are no cognitive impacts on current users.
I agree that the jury is not in yet on whether there are long-term effects years after cessation except for adolescent use (and - by the way - old people: if you are over 70, smoking pot does appear to retard dementia and cognitive decline).
Looks like the first study is for adolescent-onset usage of cannabis and they were unable to show any long term effects for adult-onset users after cessation of use, even in this observational study.
This tracks with my general understanding of the literature, and it seems like this does not really apply to an adult who has substituted cannabis for alcohol.