What happens when an LLM never sees material beyond fifth grade?

Re:What happens when an LLM never sees material beyond fifth... by wwizo on Sunday August 16, 2026 @04:27AM (#49318059)

Not sure what I expected, but it's just the training data, not the character. It'd be so cool if such systems had natural curiosity at this checkpoint. Eg:

> Me: "What's semiotic crystallography? > Response: "I don't know, what is it?"

Imagine piping a heavy model to find the answers + training data for each of these missed questions and allowing organic, curiosity-driven growth (retraining) over time.

[ Parent | on HN ]

Re:What happens when an LLM never sees material beyond fifth... by sillysaurusx on Sunday August 16, 2026 @04:33AM (#49318090)

It would lose knowledge about existing subjects unless it’s continually retrained on those too. It could help inform the next training dataset though.

[ Parent | on HN ]

Re:What happens when an LLM never sees material beyond fifth... by ramity on Sunday August 16, 2026 @05:20AM (#49318350)

Good thoughts here. Forgetting is important, but that's too advanced for modern LLMs.

[ Parent | on HN ]