Wasn't ChatGPT trained on the entirety of Wikipedia? And probably millions of pieces of scientific literature, and arts, and movies and games and and and...

Perhaps the hyperbole of the entire corpus of human knowledge isn't quite technically right, but it's close enough.

You’re also assuming these statical models learn in the same way humans do, which is very likely not true.

Tho tbh I’m not really sure what OPs point was

i don’t think the amount of training data is relevant here.