Re:GPT-5.5
by pants2 on Thursday April 23, 2026 @04:06PM
(#47881069)
Labs still aren't publishing ARC-AGI-3 scores, even though it's been out for some time. Is it because the numbers are too embarrassing?
[ Parent
| on HN ]
To be fair, there's not much to report. Isn't it pretty much at 0?
Opus-4.6 with 0.5% currently leads GPT-5.4 with 0.2%[1].
Seems meaningful even if the absolute numbers are very low. That's sort of the excitement of it.
GPT-5.5 was just released and OpenAI didnt mention ARC AGI 3 at all, their score probably sucks.
Re:GPT-5.5
by tedsanders on Thursday April 23, 2026 @09:11PM
(#47884330)
Honest answer is that it isn't done running yet. It takes some human bandwidth and time to run, so results weren't ready by this morning. We don't know what the score will be, but will probably go up on the leaderboard sometime soon. I personally don't put a lot of stock in the ARC-AGI evals, as it's not relevant to most work that people do, but should still be interesting to see as a measure of reasoning ability.
(I work at OpenAI.)
Re:GPT-5.5
by stonecauldron on Wednesday April 29, 2026 @08:11AM
(#47947233)
Because they want to keep the narrative that they'll achieve AGI with LLMs alive.