Re:What happens when an LLM never sees material beyond fifth...
by reliablereason on Sunday August 16, 2026 @04:35AM
(#49318099)
Interesting topic. That said I don't know how useful this is since LLMs are primarily trained using mode-covering training rather than Mode-seeking(RL) training, which means LLMs can not form (and does not have) the same underlying structure to their models of language that humans have.
A LLM does not learn topic by topic, it learns everything all at once and slowly integrates it in to a single knowledge system.
A LLM does not learn topic by topic, it learns everything all at once and slowly integrates it in to a single knowledge system.