I am trying to do some things to bring down those barriers. I was able to start making some earned income online while homeless. My lack of nice clothes or a recent shower did not matter. I am trying to foster that model as a thing that can help protect against sliding into homelessness, help you scrape by while on the street and be something that can help build a future that won't be taken away because you got better. Plus, it is not a homeless service, is open to anyone interested.
http://independentdigitalworkers.blogspot.com/
I was one of the top students of my graduating high school class. I got a lot of brainwashing that I was destined for greatness etc. It didn't go down that way. So I think these mental models are mostly propaganda and we need to guard against that.
With regard to your last statement, here's a (very) vaguely related post from Penelope Trunk who also writes about aspberger's and life. http://blog.penelopetrunk.com/2011/12/01/living-up-to-your-p...