Re:From GPT-4 to AGI: Counting the OOMs
by 1024core on Tuesday July 09, 2024 @11:41PM
(#40923476)
Why does it matter how it was trained?
[ Parent
| on HN ]
Because that tells us how you approach novel problems. If you need tons of data to solve a novel problem that makes you bad at solving novel problems, while humans can get up to speed in a new domain with much less training and thus solve problems the LLM can't.
Thus AGI needs to be able to learn something new with similar amounts of data as a human, or else it isn't an AGI as it wont be even close to as good as a human at novel tasks.