I'm pretty sure AGI will not be one model.

But a collection of models, with some kind of vector databases(or something more efficient than that), being orchestrated by one or multiple master models.

A large LLM that knows pretty much everything there is to know about the world, seems like a good building block for an AGI, no matter how the rest is built.

LLM's could be like the Broca's and Wernicke's area of an AGI brain. working in unison with dozens of other parts.

Or LLMs aren’t involved at all. After all LLMs work at the level of word tokens … how fundamental really are words to AGI level intelligence; the human brain doesn’t operate in the level of words, words are something we picked up, that a more fundamental mechanism at play deals with.

Humanity wasn't doing anything significant before words.

Kids workout how to manipulate parents well before they can speak?

Words help communicate ideas between people, allowing society to advance greatly, but it isn’t necessary for thinking.