The idea that words and thinking are essentially the same (linguistic determinism) was discarded decades ago. Virtually all linguists today agree that while language influences thought, thought operates far beyond the constraints of language, so a "language model" cannot realistically hope to reproduce the entire gamut of human thinking.
That assumes that a "language model" actually restricts itself to "language" as the term is used by the linguists. I strongly expect the boundaries won't match exactly, although I have no particular hunch (much less strong argument) that they will disagree enough in the right ways to make bigyikes' suspicions correct.
Perhaps "intelligence" is the process that enables these leaps between islands of words.
What often gives a clue that the child has slept is a slight change in muscle tone, or a sigh, perhaps the pace at which the baby sucks its thumb. How can that be translated into words?
I believe that thinking and idea generation is much more abstract than words. Animals seem to do a lot of idea generation (improvisation) without knowing about words.
But they cannot pass this knowledge efficiently, except from imitation.
Weak AGI will be the first language model that is able to somehow influence the thoughts of the person communicating with it, I think that is the milestone of AGI. From my experience with GPT-Neo and OPT and using it to help write stories or make chatbots, the responses are still very reactionary. In that sense, adding more parameters helps the model give a more coherent response, but it's still a response.
https://mcgovern.mit.edu/2019/05/02/ask-the-brain-can-we-thi...
Turns out, that might not be the case-i.e. understanding is probably not a linguistic phenomenon.
Sometimes, after I put down the crack pipe, I think that understanding and experiencing are two names for something that's fundamentally the same. When I'm thinking about code or a proof, my brain filters out the spacing of the letters, the smell of the paper, etc-which are things I'd do while I'm reading it for the first time. There's these common tools/filters - intuitions - that are exactly the same in thinking and experiencing.
I don't think GPT3 can understand color, for example. But if we fed it a bunch of RGB transforms and raw data, and it generalized and applied them perfectly, could we say then that it's generally intelligent? IDFK
I know, I know, it’s just a language model.
But I’ve been thinking. About my thinking. I think in words. I solve problems in words. I communicate results in words. If I had no body, and you could only interact with me via text, would I look that much different than GPT?
Does AGI really need anything more than words? Is it possible that simply adding more parameters to today’s transformer models will yield AGI? It seems increasingly plausible to me.