News for hackers. Stuff that matters.
Re:AI doppelgänger experiment – Part 1: The training by astrange on Sunday May 19, 2024 @08:28PM (#40410854)
Chomsky's critique of LLMs was somehow not even correct about his own theories (https://x.com/profraha/status/1634311282135318529). And of course has the usual problem of 1. claiming LLMs are random statistical models (they aren't, the sampler is) 2. claiming instead of generating correct text they only "seemingly" generate correct text and not explaining why this is any less impossible.

But people have built explicit grammar knowledge into LLMs (it's in llama.cpp) and nobody seems to need it to make English text.

Of course the main reason Chomsky is a crank is that he's completely convinced he's right about politics despite his unbroken record of endorsing every mass murderer in the world as long as they're anti-American.

Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Sunday May 19, 2024 @08:41PM (#40410938)
Oh right ok like I guessed, you have a ideological problem with him and his entirely irrelevant activism offends you, and so discredit any of his actual technical analysis on the subject. Maybe you do have the same faculty of reasoning as a LLM.
Re:AI doppelgänger experiment – Part 1: The training by optimalsolver on Monday May 20, 2024 @05:48AM (#40413828)
I swear there's a personality type that simply can't resist injecting their politics into unrelated conversations.

It's truly fascinating.

Re:AI doppelgänger experiment – Part 1: The training by astrange on Monday May 20, 2024 @10:40PM (#40423468)
I don't think that the opinion "70s intellectuals' love of the genocidal Khmer Rouge is bad" is "my" politics. I think this is a commonly held opinion actually.
Re:AI doppelgänger experiment – Part 1: The training by monadINtop on Friday May 24, 2024 @10:08AM (#40466433)
https://www.jstor.org/stable/25006809

https://www.counterpunch.org/2021/09/10/noam-chomsky-and-the...

stop spreading lies that have been debunked for decades, not everyone share your inability to parse information from outside your ideological bubble