News for hackers. Stuff that matters.
Re:What Comes After AGI? by HarHarVeryFunny on Friday November 20, 2026 @10:58AM (#50576707)
I think LLMs really can be thought of as a type of expert system, but obviously with some extremely important differences:

- the training procedure learns the rules, rather than them needing to be hand entered by an army of knowledge engineers

- the training procedure learns it's own embedding-based representations, rather than a human designed representation like Cyc's CycL

- the training procedure not only learns the rules & representation, but also the inference rules needed to utilize them

I don't think scale, or number of post-training RL environments, is enough to achieve generality - it can only make the forest of narrow intelligences/capabilities more dense. To achieve generality and creativity any system is going to need to support runtime directed exploration based on it's own gaps - it's impossible (even in theory) to anticipate every future configuration of the world and to pre-train for it! You also, by definition, can't pre-train for creativity and unanticipated novelty - that needs to happen at runtime via traits that are built into the system.

There are no comments on this comment yet.