This is a healthy skepticism but the difference was that using Messenger chatbots was a disjointed, clunky experience that felt slower than just a few taps in the OpenTable app. Not to mention that their natural language understanding was only marginally better than Siri at best, and so produced a null "Sorry I can't help you with that" result very often.
In this scenario, it seems dramatically faster to type or speak "Find me a dinner reservation for 4 tomorrow at a Thai or Vietnamese restaurant near me." than to browse Google Maps or OpenTable.
Yeah being able to generate media/text is what excites me about these models, more than using my voice or a text input to do X instead of a webpage which has a GUI and buttons and text boxes.
This time it works.
>but they were fundamentally capable of the same things.
This is not the case. The difference between current state of the art NLP and chatbots 3 years ago is so massive, it has to be seen as qualitative. Pre GPT-3 computers did not understand language and no commerical chatbot had any AI. Now computers can understand language.
> Now computers can understand language.
"understand"
If I tell it to do X, and it does X, for all practical purposes it means that it understood what I said.
it was taught to react in specific way on specific word, the same thing you can train dog to bark on "quantum physics" phrase.
It can invent words, and then correctly use them to compose.
it can invent words, because gpt is amazing pattern extrapolator.
Okay, but who "taught it to bark" correctly in response to those words?
you can read papers how gpt was trained?
You're making a specific claim here: "it was taught to react in specific way on specific word", and I'm giving you a specific example of an invented word that GPT used to full effect when composing. Can you explain how it was "taught to react" to this word in a manner that enables it to use it in the new meaning that wasn't even in its training set?
I answered you, gpt is pattern extrapolator and was taught to be so, creating new word is totally fits pattern extrapolation.
How about using that invented word consistently afterwards?
It seems to me that the argument you're trying to make can be extended more or less indefinitely, though. But there's a point at which "it's a pattern extrapolator" becomes less of an explanation and more of a largely irrelevant piece of trivia.
Well if it can bark out the right answer its an impressive damned dog...
the thing it doesn't bark right answer very often, but bark non-sense because was training on predicting next word in sentence.
Re:ChatGPT Plugins
by dan_mctree on Thursday March 23, 2023 @07:25PM
(#35282964)
At this point ChatGPT is blowing our human ability to use language so far out of the water on so many levels, I'd argue we should start putting quotes around our human ability to "understand" language. GPT-4 has already eclipsed us when it comes to language
Not only did the hype not pan out, but it feels as if they were completely forgotten.
In a nutshell that's why I'm still largely dismissive of anything related to GPT. It's 2016-2018 all over again. Same tech demos. Same promises. Same hype. I honestly can't see the big fundamental breakthroughs or major shifts. I just see improvements, but not game-changing ones.