Re:Language models and linguistic theories beyond words
by TeMPOraL on Thursday November 16, 2023 @07:20AM
(#38288647)
> Let it passively listen to the same sounds and speech as a baby hears in its first five years, over five years of operation.
First of all, a baby does not passively listen. It sees and touches and smells and feels, and moves and makes sounds, and observes reactions, and correlates all that with the sounds it hears.
Secondly, with the above in mind, why on Earth would you expect it to "do absolutely nothing of any use"? It feels obvious it'll start honing in on language, with even better grounding (but worse performance) than a LLM. And I fully expect there to be a to merge such model with an LLM, the same way people combine LLMs with image generators.
First of all, a baby does not passively listen. It sees and touches and smells and feels, and moves and makes sounds, and observes reactions, and correlates all that with the sounds it hears.
Secondly, with the above in mind, why on Earth would you expect it to "do absolutely nothing of any use"? It feels obvious it'll start honing in on language, with even better grounding (but worse performance) than a LLM. And I fully expect there to be a to merge such model with an LLM, the same way people combine LLMs with image generators.