News for hackers. Stuff that matters.

A comment on OpenAI O3 breakthrough high score on ARC-AGI-PUB. Parent comment

Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB by zebomon on Friday December 20, 2024 @01:34PM (#42473537)
It's a test on which (apparently until now) the vast majority of humans have far outperformed all machine systems.
[ Parent | on HN ]
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB by patrickhogan1 on Friday December 20, 2024 @01:36PM (#42473559)
But it’s not a test that directly shows general intelligence.

I am excited no less! This is huge improvement.

How does this do on SWE Bench?

[ Parent | on HN ]
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB by og_kalu on Friday December 20, 2024 @01:41PM (#42473613)
>How does this do on SWE Bench?

71.7%

[ Parent | on HN ]
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB by throwaway0123_5 on Friday December 20, 2024 @02:01PM (#42473815)
I've seen this figure on a few tech news websites and reddit but can't find an official source. If it was in the video I must have missed it, where is this coming from?
[ Parent | on HN ]
Re:OpenAI O3 breakthrough high score on ARC-AGI-PUB by og_kalu on Friday December 20, 2024 @02:03PM (#42473836)
It was in the video. I don't know if Open ai have a page up yet
[ Parent | on HN ]