Re:There Is No A.I
by visarga on Saturday April 22, 2023 @03:38AM
(#35664247)
> To me it shows how fundamental language is to intelligence.
I believe most human intelligence is based on language. We are smart because language gives us the keys to solving all sorts of situations, based on the experience of prior generations. We are wondering if GPT architecture can generate real understanding, but forgetting the training corpus. The language corpus is the real magic here. The source and accumulation point of intelligence.
Take a baby and give it access to language, you get a modern human. Take a random init neural net, use language corpus for training, you get GPT4. It doesn't matter what the model is - brain or transformer, it doesn't matter if it's a transformer or just a RNN (RWKV). What matters is the training signal.
We should not be wondering how come computers got so smart now, we should be wondering how smart is Language. Language is a separate evolutionary system of ideas and concepts. It is a self replicator, like DNA.
I believe most human intelligence is based on language. We are smart because language gives us the keys to solving all sorts of situations, based on the experience of prior generations. We are wondering if GPT architecture can generate real understanding, but forgetting the training corpus. The language corpus is the real magic here. The source and accumulation point of intelligence.
Take a baby and give it access to language, you get a modern human. Take a random init neural net, use language corpus for training, you get GPT4. It doesn't matter what the model is - brain or transformer, it doesn't matter if it's a transformer or just a RNN (RWKV). What matters is the training signal.
We should not be wondering how come computers got so smart now, we should be wondering how smart is Language. Language is a separate evolutionary system of ideas and concepts. It is a self replicator, like DNA.