News for hackers. Stuff that matters.
Re:GPT-5.5 by pants2 on Thursday April 23, 2026 @04:06PM (#47881069)
Labs still aren't publishing ARC-AGI-3 scores, even though it's been out for some time. Is it because the numbers are too embarrassing?
Re:GPT-5.5 by kilroy123 on Thursday April 23, 2026 @04:11PM (#47881143)
To be fair, there's not much to report. Isn't it pretty much at 0?
Re:GPT-5.5 by pants2 on Thursday April 23, 2026 @05:39PM (#47882436)
Opus-4.6 with 0.5% currently leads GPT-5.4 with 0.2%[1].

Seems meaningful even if the absolute numbers are very low. That's sort of the excitement of it.

2. https://arcprize.org/leaderboard

Re:GPT-5.5 by AG25 on Thursday April 23, 2026 @05:00PM (#47881903)
GPT-5.5 was just released and OpenAI didnt mention ARC AGI 3 at all, their score probably sucks.
Re:GPT-5.5 by tedsanders on Thursday April 23, 2026 @09:11PM (#47884330)
Honest answer is that it isn't done running yet. It takes some human bandwidth and time to run, so results weren't ready by this morning. We don't know what the score will be, but will probably go up on the leaderboard sometime soon. I personally don't put a lot of stock in the ARC-AGI evals, as it's not relevant to most work that people do, but should still be interesting to see as a measure of reasoning ability.

(I work at OpenAI.)

Re:GPT-5.5 by stonecauldron on Wednesday April 29, 2026 @08:11AM (#47947233)
Because they want to keep the narrative that they'll achieve AGI with LLMs alive.