News for hackers. Stuff that matters.
Re:Arc Prize 2024 Winners and Technical Report by thomasahle on Friday December 06, 2024 @07:58PM (#42346267)
> What surprises me about this is how poorly general-purpose LLMs do. The best one is OpenAI o1-preview at 18%.

o1-preview doesn't even have image input, so I wonder how they used it.

Also, Ryan Greenblatts solution basically does "best of 4000" iirc. Presumably o1-preview was single shot.

Re:Arc Prize 2024 Winners and Technical Report by celeritascelery on Friday December 06, 2024 @11:45PM (#42347333)
None of the models use images, they all operate and a json format the describes the input squares.