News for hackers. Stuff that matters.
Re:The last six months in LLMs, illustrated by pelicans on b... by MattRix on Sunday June 08, 2025 @03:55PM (#44219145)
This is why things like the ARC Prize are better ways of approaching this: https://arcprize.org
Re:The last six months in LLMs, illustrated by pelicans on b... by whiplash451 on Monday June 09, 2025 @02:20AM (#44221840)
Well, ARC-1 did not end well for the competitors of tech giants and it’s very unclear that ARC-2 won’t follow the same trajectory.
Re:The last six months in LLMs, illustrated by pelicans on b... by wolfmanstout on Monday June 09, 2025 @09:27PM (#44231539)
This doesn’t make ARC a bad benchmark. Tech giants will have a significant advantage in any benchmark they are interested in, _especially_ if the benchmark correlates with true general intelligence.