Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by tesch1 on Saturday December 21, 2024 @08:13AM
(#42479456)
But maybe it's something more like general symbolic manipulation, and not specifically the sounds or structure of language. Reading is fairly new and unlikely to have had much if any evolutionary pressure in many populations who are now quite literate. Same seems true for music. Maybe the hardware is actually more general and adaptable and not just for language?
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by HumanOstrich on Saturday December 21, 2024 @08:26AM
(#42479531)
The research disagrees with you.
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB
by eru on Saturday December 21, 2024 @09:25AM
(#42479872)
Music is really, really old.
And reading and music co-evolved to be relatively easy for humans to do.
(See how computers have a much easier time reading barcodes and QR codes, with much less general processing power than it takes them to decipher human hand-writing. But good luck trying to teach humans to read QR codes fluently.)
That seems like a decent example of pretraining through evolution.