News for hackers. Stuff that matters.
Re:Chomsky Explains Why Nobody Is a Moral Relativist, Even M... by coldtea on Thursday September 28, 2023 @09:01AM (#37689030)
>without starting out with an inborn sense of grammar

I'm not so sure though, because it starts by being fed sentences assembled by people.

Sort of how we wouldn't say that a book itself has a "good command of language", but that the writer has one, and put it in the book.

So you might need a seed with "an inborn sense of grammar" to create language first and a training corpus second, but once that's available in huge volumes you can mechanically train an LLM to appear to have a "good command of language" just by brute force.

Would an LLM gain a "good command of language" if it was just fed all the taling a human hears and the words it reads in its first 18 years of life?

Re:Chomsky Explains Why Nobody Is a Moral Relativist, Even M... by ajuc on Thursday September 28, 2023 @09:05AM (#37689068)
> Would an LLM gain a "good command of language" if it was just fed all the taling a human hears and the words it reads in its first 18 years of life?

Depends on what its starting weights are ;)

Re:Chomsky Explains Why Nobody Is a Moral Relativist, Even M... by BobbyJo on Thursday September 28, 2023 @10:07AM (#37689802)
Aaaaaaand we're back to inborn sense.