I gave GPT-3 a prompt to test this. Like a human reader would, GPT-3 seems to miss the doubled word in the last sentence. Continuation is at the asterisk.
Repeat the sentence in quotes.
"The man went to the gas station today."
The man went to the gas station today.
"I'm happy to be on holiday."
I'm happy to be on holiday.
"If you can get to the the store on time, it would be appreciated"
If you can get to the store on time, it would be appreciated.
What's extra-odd about this is that GPT-3 can repeat random character sequences up to 1,000 characters in legnth. For each of these I just gave the sentence in quotes and let GPT-3 autocomplete the repeat. I think that's especially odd because it's showing that GPT-3 does something different when it is asked to repeat random characters (wouldn't miss a duplicate) versus when it is asked to repeat sentences that it could "read".
"I need something stronger than I'm XXXknjd used to."
I need something stronger than I'm XXXknjd used to.
"pmkkrrpjvn"
pmkkrrpjvn
"wxvbssajxczjjewmanvzznxlwzwdvfrghsstmzpvqwsstrxkzunjgxicvrshychbqsulydkiwgyryhkgjtukssacnodtggfahvus"
wxvbssajxczjjewmanvzznxlwzwdvfrghsstmzpvqwsstrxkzunjgxicvrshychbqsulydkiwgyryhkgjtukssacnodtggfahvus
"dcyvufmxwmctighwwhmamgwuyldpkzrwubvcbjirxzhuoqtktcdfjgasurcprctnxmlqfvwkxixrtqqynxfjvtfhmgsfglxhvfhnbqnixulexkqflrdxqpwgavrphkbgspgoyfjfolczssjfrmggtpcdheneaynhdwimcmvkcsauxwnlovefpmqyznynuoxraqixeveiuqotssiymrtmbiodwnhmtexfrttzdlbdwduqzvrkpmqmjcyciqsuwqmlhjrveeozktvccsspsqosutpngigzkqgaltojhvkodzoeqzhlhfqyblvqkoyvjkphmjroidjpbpnkvrchvrnvuoqhgzkypvjycfzrdsyefstckorqwgsbknslqyiwqghdinuwrapkgyvhslbfgqrslsrferhodlvukdsvvzdcwyjwtrqhqkvwbwksefuanzaarvhnmjcgtajsbivaijthercbmqfvndlsfhjtwsiztpwcehuvckmcbjvhnqbvhhqwugrodtyjfrwlkbpatpwgrlzneenyqgcdyzzhrzfsrvfqlnunfpnathcpuealrdwcliriufxdfqaygxtvdriidzzzdbbfwrowhlbasogmzfkwhaaufrcjsdgdobaozazbdfmasrgjiblluvfvfkeuwksyrzdmepmapesadqoozrpaidlgshyhpbypdzdxjdtwnfaxthjwluarbldmxvvfdissthlpdxqxjmgpuefwqvfjupxveztgrrwyobgaljqkgexeulvjucokythfkmcgnlbfkmpgrpaoztrawqciyilbzwjxagwqgwuqcwactwdtobomlkanmdbhpmubdzvolqpusjbtgqoymuovzsqbkzonabhzogabraxmnxnvfdotfisefmfbdbqjzgrhdtgtppobyndfgsrlpxyutebzlrxgahwizvtmieutqnkflkldxeathvrttyffacofuwdkhxdklcisbzbrlddtahut"
dcyvufmxwmctighwwhmamgwuyldpkzrwubvcbjirxzhuoqtktcdfjgasurcprctnxmlqfvwkxixrtqqynxfjvtfhmgsfglxhvfhnbqnixulexkqflrdxqpwgavrphkbgspgoyfjfolczssjfrmggtpcdheneaynhdwimcmvkcsauxwnlovefpmqyznynuoxraqixeveiuqotssiymrtmbiodwnhmtexfrttzdlbdwduqzvrkpmqmjcyciqsuwqmlhjrveeozktvccsspsqosutpngigzkqgaltojhvkodzoeqzhlhfqyblvqkoyvjkphmjroidjpbpnkvrchvrnvuoqhgzkypvjycfzrdsyefstckorqwgsbknslqyiwqghdinuwrapkgyvhslbfgqrslsrferhodlvukdsvvzdcwyjwtrqhqkvwbwksefuanzaarvhnmjcgtajsbivaijthercbmqfvndlsfhjtwsiztpwcehuvckmcbjvhnqbvhhqwugrodtyjfrwlkbpatpwgrlzneenyqgcdyzzhrzfsrvfqlnunfpnathcpuealrdwcliriufxdfqaygxtvdriidzzzdbbfwrowhlbasogmzfkwhaaufrcjsdgdobaozazbdfmasrgjiblluvfvfkeuwksyrzdmepmapesadqoozrpaidlgshyhpbypdzdxjdtwnfaxthjwluarbldmxvvfdissthlpdxqxjmgpuefwqvfjupxveztgrrwyobgaljqkgexeulvjucokythfkmcgnlbfkmpgrpaoztrawqciyilbzwjxagwqgwuqcwactwdtobomlkanmdbhpmubdzvolqpusjbtgqoymuovzsqbkzonabhzogabraxmnxnvfdotfisefmfbdbqjzgrhdtgtppobyndfgsrlpxyutebzlrxgahwizvtmieutqnkflkldxeathvrttyffacofuwdkhxdklcisbzbrlddtahut
On any given input, its predictions can "look" how we expect an intelligent response to "look". The job is to disprove this intuition, which is usually trivial. This cannot be done by looking at a single response.
Consider walking into a room and predicting a few people's personality traits correctly based on their star sign. This shows nothing.
Most research on deep net architecture, is about how to train it effectively on huge stacks of GPUs and TPUs. That's how/why transformers were invented.
Going eg., from 100TB training to 300BB weights. The process of training is more-or-less just "building a search index", and prediction is little more than "looking up examples in the search index and combining".
Yes, one of the key insights of modern DL-based ML is that size matters, neural networks start producing interesting generalisation only once you have large parameter spaces. Indeed, one might wonder if size is all that matters?
I don't see what is wrong with search indices, every computer is a gigantic search index, because main memory is a map from an index (the memory address) to 2^n bit integers, the value stored at the index. So anything that can be computed at all, can be computed by "a search index". The important thing that, prima facie, distinguish NNs from eg SQL databases, is the use real numbers as latent space: because real numbers are a metric space, so you have a notion of distance which allows you do use efficient local search like gradient descent. Moreover, when you ask this 'mere' search index (NNs) about something that it was not trained on, it can (and probably does) return something that is close in this metric space to something it learned.
That did not work at all in the 1990s. Today it works spectacularly well in some domains. So an interesting question now is, to use your language: is human intelligence anything more than "building a search index" and "looking up examples in the search index and combining"? So this is a variation of Searle's Chinese room, but unlike him in 1980, we have working Chinese rooms!
For example, we act in the world so as to set the state of possible causal variables -- and thereby can distinguis causes.
Above, graph algorithms operate on a discrete graph space and hence on the graph. GPT here isn't doing that.
Seeing NNs as distance-based searches in a compressed 'training space' demystifies what solutions can be found.
Here the text space defined by the training set does not permit a graph traversal, so eg., the NN 'uses' edges that don't exist
We are not searches across such spaces, which are radically impoverished and not parametrised by time or action
It is true that LLMs cannot currently solve complex mathematics problems reliably. Whether that's an intrinsic shortcoming of transformers, or not is an interesting open question, that is being investigated as we speak. A lot of well-known DL research teams bet on transformers beating humans in mathematics in the next few years, see e.g.
https://imo-grand-challenge.github.io/Yes, it is more than this. Even if we can simulate things that appear like thinking using these methods, what we do bears no comparison. That's not a criticism of the computer here but the brain doesn't work like this.
Ultimately, maybe the question "can computers think" is meaningless as Turing himself said. If the output appears like it is the product of thought, then what difference does it make?
It's really not.
You are compressing the information in that dataset. That means the model has to learn characteristics of the information in the data that represent it. This is one of the reasons why some argue that compression is a form of intelligence[1]
It's a very different mechanism to a search index or database even if in some case it appears to work similarly.
Be that as it may, universality in computing models is a well known issue. I could also say "Every Model Learned by Gradient Descent Is an x86 processor + a lot of RAM", or ""Every Model Learned by Gradient Descent Is a 2 Layer Neural Net" (as 2 layer nets are universal approximators), but this is not terribly illuminating.