News for hackers. Stuff that matters.

A comment on 'Godfather of AI' Geoffrey Hinton says it could drive humans extinct in 10 years. Parent comment

Re:'Godfather of AI' Geoffrey Hinton says it could drive hum... by ottaborra on Wednesday January 01, 2025 @03:26AM (#42564721)
I don't understand. If kaggle solutions were able to do those, what the hell do these mean?

https://arcprize.org/2024-results

[ Parent | on HN ]
Re:'Godfather of AI' Geoffrey Hinton says it could drive hum... by crackrook on Wednesday January 01, 2025 @07:08PM (#42570380)
No individual Kaggle solution achieved a result of 81%, rather an ensemble of models: https://x.com/fchollet/status/1865865271728390515

In my (possibly flawed) interpretation: o3's scores appear to be an achievement because they were attained by a single model, but the benchmark itself needs refinement before it can claim to be a measure of AGI like it set out to be, as one can bruteforce their way to similar results.

[ Parent | on HN ]