Really? how do you know this? Are you an expert in this area and this is actually something experts are talking about or is this just an educated guess? Serious question.
No this is not true. The reason why chatGPT is better then GPT-3 is because it's trained on additional reinforcement data to determine good and bad answers. They basically outsourced and hired a bunch of Kenyans to do this.
If they hire say a computer scientist to reinforce the code and rate the best coded answers then it can improve in that specific specialty. There is ALOT of room for additional sets of this type of data.
Are you sure you know this as an expert in this area or you're just agreeing with him as a layman? I'm certainly a layman myself.
The RL model made the responses more useful by determining what is and is not a useful reply, then re-running on non-useful replies. It doesn't actually increase the knowledge or the LLM in a meaningful way; it does increase the precision, which is viewed as a form of increased performance? But the RL model cannot inject new facts, and cannot perform reasoning to a greater degree than the LLM can.
Let's say we layer an RL model with training that doubles the size of the current LLM. I think most of the counter examples of performance failures of chatGPT in this thread will become nill.
Thanks for responding btw. Good to hear the opinion of an expert.
Over our lifetime we constantly learn rules which constrain the list of expected behaviours we expect in the world. Some of the rules are logical, scientific and mathematical others are specific to individual groups and societies.
And those rules should be largely immutable where the user can't convince ChatGPT to chat them at runtime.
https://medicalxpress.com/news/2021-12-mass-human-brain-cell...
(This link is quite disturbing)
I have no doubt you're right in general, though. My intuition is that a general-purpose cognitive engine that is capable of fully classifying, understanding, and manipulating the world around it will happen in my lifetime, I'm almost sure of it. I can't wait!