There's a very interesting story about Nancy, an incommunicative, self-destructive, schizophrenic, dying eleven-year-old girl who was administered a high dose of LSD in the 60's.[1][2][3] You'd think she might not be the best candidate for a strong psychedelic experience. But it reportedly saved her life, and helped restore her to sanity. There have been many other cases of psychedelics being used to treat mentally ill people, with impressive results.
Some people do react negatively, but in those cases I really wonder which drug(s) they took, what the dosage was, what their mindset was, what environment they took it in, who they took it with, what they did during the trip, and what intention they had. I would be willing to bet that in most cases many of these factors were far from ideal, and if they'd used them more constructively they would have probably had a better experience.
I do believe it's possible to abuse these drugs, mostly by not taking them seriously enough and not treating them with enough respect, taking them only to "party" or even with destructive intent. And, yes, maybe some people just won't be able to handle psychedelics no matter what. Maybe.
[1] - https://bpaste.net/raw/c86b011161ca
http://reset.me/personal-story/personal-story-ayahuasca-addi...
But I think if there wasn't the stigma legal or otherwise, the use of these substances would be much safer. An experienced guide like a sitter or a shaman can guide people through rough experiences and encourage the uplifting ones.