News for hackers. Stuff that matters.

A comment on Advent of Code 2025: Number of puzzles reduce from 25 to 12 for the first time. Parent comment

Re:Advent of Code 2025: Number of puzzles reduce from 25 to ... by Gigachad on Sunday October 26, 2025 @07:22AM (#45710865)
Have a look at https://arcprize.org/

They have hundreds of challenges that humans can solve in under a minute which LLMs can not. Seems the general trend is figuring out the rules or patterns of the challenge when there are few examples and no instructions.

[ Parent | on HN ]
Re:Advent of Code 2025: Number of puzzles reduce from 25 to ... by petesergeant on Sunday October 26, 2025 @07:35AM (#45710920)
Ah, it also needs to be challenging for humans. It's a prize to win something. I just didn't want people to throw the question into Claude Code.
[ Parent | on HN ]
Re:Advent of Code 2025: Number of puzzles reduce from 25 to ... by mewpmewp2 on Sunday October 26, 2025 @01:06PM (#45713460)
Perhaps coding exercises that require 2d or 3d thinking, or similar. This is where I have seen LLMs struggle a lot. There are probably other areas too.
[ Parent | on HN ]