News for hackers. Stuff that matters.
Re:Chomsky and the Two Cultures of Statistical Learning by codeulike on Friday November 06, 2026 @11:34AM (#50394620)
The existence of LLMs is telling us something, surely it means something. I'm not sure we've quite figured it out yet but its probably something along the lines of 'intelligence might not be as complicated as we thought' ... a fourth narcissistic blow to humanity after Copernicus, Darwin and Freud.
Re:Chomsky and the Two Cultures of Statistical Learning by ckcheng on Friday November 06, 2026 @12:06PM (#50395083)
The narcissism might not be in thinking 'intelligence might not be as complicated as we thought’ - the narcissism might be in thinking ‘LLM intelligence is the way we thought’.
Re:Chomsky and the Two Cultures of Statistical Learning by trgn on Friday November 06, 2026 @12:14PM (#50395229)
I understand the charge, but it's soemwhat unfair. It's more like we start to see a correspondence which even 20 years ago was barely considered
Re:Chomsky and the Two Cultures of Statistical Learning by goatlover on Friday November 06, 2026 @05:02PM (#50399095)
It's also not the first time a breakthrough technology was compared to the human brain/mind, but we also know biologically animal nervous systems are not digital computers, telephone/telegraph networks or hydraulic systems.
Re:Chomsky and the Two Cultures of Statistical Learning by codeulike on Friday November 06, 2026 @06:57PM (#50400177)
I'm not saying LLMs work in the same way as us. But a few years ago humans used to be the only competent users of language on the planet. Now its humans + LLMs who are competent users of langauge. This is a big change, and I'm saying that it might be pointing to something deeper about complexity and how approaches to deal with complexity arise in the universe.
Re:Chomsky and the Two Cultures of Statistical Learning by trgn on Saturday November 07, 2026 @09:05AM (#50404641)
sure, but its facile to dismiss these breakthroughs as naive metaphors. physicans do understand now many bodily systems can be modeled with the same tools an engineer will model his machines. its not because these abstractions are incomplete, they are wrong.
Re:Chomsky and the Two Cultures of Statistical Learning by codeulike on Friday November 06, 2026 @12:15PM (#50395244)
Even if you just consider LLMs to be stochastic parrots, its still a blow to humans, as in 'a sufficiently sophisticated stochastic parrot can actually be fairly capable'. Its like Searle's Chinese Room suddenly arrives and turns out to be pretty handy at office jobs. Its a significant change.
Re:Chomsky and the Two Cultures of Statistical Learning by goatlover on Friday November 06, 2026 @04:57PM (#50399044)
We train them on the sum of human knowledge available in digital format, so I'm not sure that's an indictment, and the large models are incredibly complicated to the point it's hard to reverse engineer how they work so well and what they're actually doing to build internal models to predict the next token. Several billion to several trillion parameters is anything but simple.
Re:Chomsky and the Two Cultures of Statistical Learning by codeulike on Friday November 06, 2026 @06:46PM (#50400077)
Right, we needed compute on a large and fast scale to make LLMs actually work. But the basic principles are quite simple: train on a huge dataset for long enough, using some fairly simple ML maths but across a very large dimensional space, and then out the other side you get something that can competently use language, and is capable of doing useful work. This is somewhat surprising, no?
Re:Chomsky and the Two Cultures of Statistical Learning by goatlover on Friday November 06, 2026 @07:42PM (#50400477)
Yes, it is surprising.
Re:Chomsky and the Two Cultures of Statistical Learning by peterfirefly on Friday November 06, 2026 @07:22PM (#50400353)
Freud doesn't belong in that group. Freud was a fraud.
Re:Chomsky and the Two Cultures of Statistical Learning by codeulike on Saturday November 07, 2026 @06:17AM (#50403537)
Right, I'm not really into Freudian therapy and a lot of his stuff was subjective rather than scientific. Freud is commonly put in that group because (a) he rather boldly declared himself part of it and (b) his name is a token for the idea of "we dont know ourselves as well as we think, and we are very capable of deceiving ourselves" ... this was an idea that was around a long time before freud but he formalised the vocabulary around it (subconscious etc) and so his name is now strongly associated with that idea.