Re:Modern language models refute Chomsky’s approach to language
by enord on Tuesday June 13, 2023 @05:43PM
(#36317906)
The «air» is here an allegory for «large language corpus». It is self-evidently true that as we move backwards through history we eventually pass the first language utterance for any given definition of language or utterance. From here on out, the «air» is indeed «thin». There are still other things, but no «air» (i.e. «language corpora»).
Evolution optimized for language learning abilities before the full capabilities came. Evolution is not thin air.