One key difference between humans and (current) LLMs is that we can actually judge the material we learn from at the time we're learning it, contextualize it and discard garbage when we spot it.

LLMs need an awful lot of handholding all the time, meanwhile humans get pretty good at it on their own.