Re:Modern language models refute Chomsky’s approach to language
by aezart on Tuesday June 13, 2023 @03:24PM
(#36315560)
Not for a lack of trying.
If you give it a small enough training set or a big enough neural network, it will directly memorize the whole thing. You have to intentionally make its brain too small to do that in order to force it to find patterns in the data instead.
If you give it a small enough training set or a big enough neural network, it will directly memorize the whole thing. You have to intentionally make its brain too small to do that in order to force it to find patterns in the data instead.