Re:The "it" in AI models is the dataset
by nicklecompte on Thursday April 25, 2024 @07:54AM
(#40156345)
> in the revelation that the robots don't need the expertise of humanity's greatest experts and masters
If it's any consolation, this is more of a delusion than a revelation. Throwing gigantic piles of data at extremely primitive artificial neural networks[1] succceeds at artificial benchmarks and might get OpenAI over the line of commercial viability. But GPT still doesn't understand what numbers are, either in text or visually. Sora doesn't understand causality or object permanence. DALL-E doesn't have a clue what a dog or a cat actually is (despite the misleading claim in the post).
"Scaling is all you need" will be an ironic slogan of the upcoming AI winter. These machines have read more text and watched more videos than 1,000 humans could do in their lifetimes... and they're still dramatically dumber than mice.
[1] "primitive" relative to biological neurons, obviously they are quite fancy relative to other software.
If it's any consolation, this is more of a delusion than a revelation. Throwing gigantic piles of data at extremely primitive artificial neural networks[1] succceeds at artificial benchmarks and might get OpenAI over the line of commercial viability. But GPT still doesn't understand what numbers are, either in text or visually. Sora doesn't understand causality or object permanence. DALL-E doesn't have a clue what a dog or a cat actually is (despite the misleading claim in the post).
"Scaling is all you need" will be an ironic slogan of the upcoming AI winter. These machines have read more text and watched more videos than 1,000 humans could do in their lifetimes... and they're still dramatically dumber than mice.
[1] "primitive" relative to biological neurons, obviously they are quite fancy relative to other software.