News for hackers. Stuff that matters.

A comment on Modern language models refute Chomsky’s approach to language. Parent comment

Re:Modern language models refute Chomsky’s approach to language by version_five on Tuesday June 13, 2023 @03:54PM (#36315994)
A kind of corollary that I'm sure others have thought of: if llms are so smart and human thought is nothing more than a big language model, why can't they (llms) make up their own training data. Any discussion about how they are "thinking" the way we do is BS, I don't know how so many people who know better have been conned.
[ Parent | on HN ]
Re:Modern language models refute Chomsky’s approach to language by og_kalu on Tuesday June 13, 2023 @04:17PM (#36316394)
Haha what ? They can make training data just fine. https://arxiv.org/abs/2305.07759
[ Parent | on HN ]
Re:Modern language models refute Chomsky’s approach to language by pepa65 on Tuesday June 13, 2023 @09:45PM (#36320311)
Only after they have been fed human language, which was the point.
[ Parent | on HN ]
Re:Modern language models refute Chomsky’s approach to language by og_kalu on Tuesday June 13, 2023 @10:12PM (#36320546)
That wasn't the point lol. Read his comment. It wouldn't even make any sense. What do you think you're fed ? alien data ?
[ Parent | on HN ]
Re:Modern language models refute Chomsky’s approach to language by toyg on Tuesday June 13, 2023 @04:09PM (#36316240)
> I don't know how so many people who know better have been conned.

The simple reason is: because they don't actually "know better". Maybe they are knowledgeable and skilled in some area, but that doesn't mean they are knowledgeable and skilled in everything.

[ Parent | on HN ]
Re:Modern language models refute Chomsky’s approach to language by og_kalu on Tuesday June 13, 2023 @04:18PM (#36316413)
Or...you know he's just wrong. No idea why he thinks making training data is this unsurmountable task. https://arxiv.org/abs/2305.07759
[ Parent | on HN ]