News for hackers. Stuff that matters.
Re:Modern language models refute Chomsky’s approach to language by QuadmasterXLII on Tuesday June 13, 2023 @03:28PM (#36315622)
Individual humans aren’t, but we’re talking about the emergent properties of a swarm of humans. 6 gigabytes of dna describes an entity that, if copied 60 times and dropped on an island, will produce a viable language in inly a few decades. We haven’t found a NN architecture with this property for language, but we have for , eg, chess, starcraft, and go
Re:Modern language models refute Chomsky’s approach to language by datameta on Tuesday June 13, 2023 @03:46PM (#36315889)
This might be too overarching of a statement but "kind" learning environments like games that have set rules and win conditions are very far from the turing completeness of human language.