I think you're correct about the training data problem. This is starting to remind me of the Final Question story by Asimov. "Insufficient data for meaningful answer". While in that story the AIs kept progressing, I think in reality we will forever be stuck with diminishing quality of training data.
Even just consider post-Copilot Github. Presumably there is now code publicly available that was generated by an AI. Next time somebody slurps up Github to train a new model, some of that code will be included. Overfitting ensues.
So many devs just copy paste code as is.
It seems like some people struggle with the notion of something being good in some areas and bad in others.
Why not Evaluate it on the merits of what is possible now and extrapolate in the near future. Any prediction beyond that is most likely futile anyway.
Unless you are planning to run a business or work in academy there is most likely no need to overreact even if it ground breaking next month. Everything moves more slowly than we expect anyway.
In the end useful technologies will stay while the rest will disappear into the void sooner or later.
Most people tend to take the same side their favourite celebrities do, and then argue for that to the extremes.
Also considering that humans will probably still only publish the output that looks good, even that still provides a weak signal on quality.
If language was enough (or a similar idea, that multimodal input is not useful), college math professors wouldn't use so much chalk making drawings and diagrams to explain their ideas.
This assumes that GPT4 is trained on all currently-available training data.
Is that true?
PS: Anyways, regarding your argument, yes, transformer-based models right now are "shit" (by whatever measure you are using, though I still don't know what you are comparing them with. I suppose human level intelligence), but more training data is not the only way to make better models.
One word: AlphaZero. Deepmind ran out of human go games to study, but it turned out that self-play was dramatically better. Your argument only holds if a) there's a linear relationship between the amount of training data and the quality of a model and b) GPT is close to maximally efficient in converting training data into useful weights. Both of these premises are demonstrably false.
GPT-4 is, in the scheme of what's possible, an incredibly primitive model that uses training data very inefficiently. In spite of that, a dumb brute force architecture still managed to vastly exceed everyone's expectations and advance the SOTA by a huge leap.
A simple setup for improving coding skills is the following:
1. GPT is given a coding task to implement as a high level prompt.
2. It generates unit tests to verify that the implementation is correct.
3. It generates code to implement the algorithm.
4. It runs the generated code against the generated unit tests. If there are errors generated by the interpreter/compiler, go back to Step 3, modify the code appropriately and try again.
5. If there are no errors found, take the generated code as a positive example and update the model weights with reinforcement learning.
Sorry, it won’t. This might even be peak GPT. Training data comes from human content, and currently there is decades worth of pure human content available. But new content will come in slowly, and it will probably take decades just to double the amount of training data we have today.
Worse, since we expect AI generated content to start becoming widespread and difficult to distinguish from human content, GPT will eventually start cannibalizing its own outputs as training data, leading to shittier and shittier models over time that get overfitted and no longer seem human enough for any practical use.
It’s a fading dream.