Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by indoordin0saur on Wednesday June 05, 2024 @01:06PM
(#40587523)
My point is not that humans have a faster training speed but that humans must be doing something fundamentally different from LLMs. You could build Altman's $7 trillion dollar GPU cluster and use the majority of the world's energy to feed it and you'd still hit the same limitations if you're just running an LLM on it, even a very sophisticated LLM. This is Yann LeCun's position as well.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by solidasparagus on Wednesday June 05, 2024 @01:29PM
(#40587813)
That, as I understand it, is not a valid chain of logic. Requiring fewer data points does not inherently indicate that the underlying mechanism (autogressive sequential generation, not the transformer which is just an architecture) is different.
Not to mention the secondary arguments like - no proof that human learns faster from fewer datapoints, that's just your assumption in the sibling comment. Humans inherit information. The equivalent - fine-tuning a foundation model - is very fast to learn novel objects.
Just because someone has a Turing award doesn't mean they know what they're talking about. They are just people, with strengths and weaknesses like everyone else. But often on the extreme end of strengths and weaknesses.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by retros3x on Thursday June 06, 2024 @12:00PM
(#40599006)
Well, the same thing goes for you - just because someone posts on HN doesn't mean they know what they're talking about. And if I have to decide whose assessment I trust regarding AI, I take the Turing award winner who worked for almost 40 years on AI over a random guy from the internet.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason...
by solidasparagus on Thursday June 06, 2024 @05:30PM
(#40602637)
Sure. But I'm not standing here saying my argument is valid because SolidAsparagus made it.
> And if I have to decide whose assessment I trust regarding AI, I take the Turing award winner who worked for almost 40 years on AI over a random guy from the internet.
I'd encourage you to do your own thinking and make up your own mind.
Not if they inherit from a previous generation of AI. But even if they did, a different training speed does not imply a different capability