They call them flashbacks and I suspect there's probably a large amount of urban legend going on. Anecdotally, I know many people who have taken psychedelics and have never heard a report of a flashback. That's not to say they're not a thing.

http://io9.gizmodo.com/5951972/could-you-actually-have-an-ls...