Re:Chomsky Explains Why Nobody Is a Moral Relativist, Even M...
by ajuc on Thursday September 28, 2023 @09:05AM
(#37689068)
> Would an LLM gain a "good command of language" if it was just fed all the taling a human hears and the words it reads in its first 18 years of life?
Depends on what its starting weights are ;)
I'm not so sure though, because it starts by being fed sentences assembled by people.
Sort of how we wouldn't say that a book itself has a "good command of language", but that the writer has one, and put it in the book.
So you might need a seed with "an inborn sense of grammar" to create language first and a training corpus second, but once that's available in huge volumes you can mechanically train an LLM to appear to have a "good command of language" just by brute force.
Would an LLM gain a "good command of language" if it was just fed all the taling a human hears and the words it reads in its first 18 years of life?