Re:What Comes After AGI?
by kenjackson on Friday November 20, 2026 @01:32PM
(#50579557)
Again, I'd base this on capability. For example, you state: "Memorizing facts is not the same as learning skills." Maybe it's not. I'm not convinced it's not. In the ChatGPT 4 days (or so), I taught the instance I used some chess tactics/strategy that it didn't seem to know. And it appeared to use them correctly after that. Now you might note that this isn't really learning -- they just memorized it and then applied it appropriately.
With a sufficiently large context window, can you make a lot of things look like learning. And if it's not sufficient then point out the capabilities that aren't possible with this approach. To me that much more convincing.
Memorizing facts is not the same as learning skills. Implementation-wise memorization can just be RAG, but learning does need to be in the "weights" - whatever it driving the actual behavior of the model.