I'm not claiming that an NN can't approximate human or super human intelligence, I'm claiming that using human writing as the only training set is not going to get you there.

The text simply doesn't contain enough information to draw a model of the world. Human language only makes sense if you understand the world, not the other way around.

Essentially what we're doing is similar to a human trying to learn psychology by reading books in Mandarin on it, while knowing neither the writing system nor the language. Except that human languages share some universal grammar, and share more or less the same notions about the world.