No. The author resents staying out of school because it also meant staying out of more diverse and more regular social interaction. Successful social interaction requires shared values (which wasn't really the issue) and, at least to a degree, shared social experiences. If two people have hitherto had experiences that are so divergent that ego cannot understand any of the structures or references alter uses, then social interaction becomes very difficult.
Accordingly, fitting in was difficult because of their non-standard upbringing, and while the parents might not have minded that they did not quite "fit in", the children did not have a choice of their own or even the necessary experience that would have enabled them to make an informed choice in the first place.
What is described is the removal from the Zeitgeist, which becomes a problem if others simply assume a shared set of conventions and experiences or if you would like to be part of a group that is based on different premises.
That school was (at least partially) awful was merely a symptom of this underlying social schism, not a cause.
How is sitting in a room with other people, all of whom are within 12 months of your own age, with an authority figure at the front constantly telling you what to do, a "diverse" social interaction?
American schools were designed to produce factory workers who would stay on-task based on the direction of a foreman and bells ringing at certain times. That world doesn't exist any more.
Public education is certainly in need of big reforms, but I'm grateful for the diversity I was exposed to attending one. It's a big part of what keeps me grounded in the ridiculous Silicon Valley bubble.
This ought to be less of a problem now with so many more unschoolers and homeschoolers for support; I think there are better ways to address it than by imprisoning more children rather than less; and it sounds like these ones had a better childhood on the whole and turned out fine as adults.
Imagine if all the state money that went into your schooling were invested instead for your minimum basic income: http://slatestarcodex.com/2014/05/23/ssc-gives-a-graduation-...