Re:Yann LeCun: ChatGPT is 'not particularly innovative'
by belval on Thursday January 26, 2023 @03:15PM
(#34538101)
Respectfully I don't think you read my comment. GPT3 != ChatGPT. ChatGPT is built on GPT-3 and is not breaking new ground. GPT3 is 3 years old and was breaking new ground in 2020 but Meta/Google/DeepMind all have LLM of their own which could be turned into a Chat-Something.
That's the point LeCunn is making. He's not out there negating that the paper you linked was ground-breaking, he's saying that converting that model into ChatGPT was not ground-breaking from an academic standpoint.
It wasn't a 'cosmetic' improvement over existing NLP approaches.