News for hackers. Stuff that matters.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by threeseed on Monday June 17, 2024 @07:16PM (#40712304)
a) 50% result is not solving the problem. Especially when the implementation is brute forcing the problem and is against the spirit of ARC.

b) He is not being overly negative of LLMs. In fact he believes they will play a role in any AGI system.

c) OpenAI CTO has publicly said that ChatGPT 5 will not be significantly better than existing models. So the rate of improvements you believe in simply doesn't match reality.

Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by janalsncm on Monday June 17, 2024 @07:35PM (#40712459)
For the record, a lot of problems might turn out to be like this, where we figure out a brute force approach that stands in for human creativity.
Re:Getting 50% (SoTA) on Arc-AGI with GPT-4o by hackerlight on Tuesday June 18, 2024 @12:21AM (#40714049)
Skeptical about (c), source please. She did say they don't have anything much better than GPT-4o currently, but GPT-5 likely only started training recently.