News for hackers. Stuff that matters.
Re:ARC-AGI-3 by dyauspitr on Wednesday March 25, 2026 @07:09PM (#47524496)
If anything this makes the test much harder for the LLM to get high scores and that makes the scores they’re getting all that much more impressive.
Re:ARC-AGI-3 by daveguy on Thursday March 26, 2026 @10:13AM (#47530735)
The scroes they're getting are on the order of 0-1% for this ARC-AGI-3 benchmark.
Re:ARC-AGI-3 by dyauspitr on Friday March 27, 2026 @09:10PM (#47550480)
Didn’t I just see a post about 36% from someone?
Re:ARC-AGI-3 by daveguy on Saturday March 28, 2026 @05:28PM (#47558250)
Where have you or they seen a score of 36% over the full test set? I sure haven't seen that.