News for hackers. Stuff that matters.
Re:Advent of Code 2023's new AI/LLM Policy by reedf1 on Monday October 16, 2023 @12:00PM (#37901763)
I can't help but feel part of the meaning drops out of it when there are carve outs for tools. If an AI can do it instantly, it starts to feel like pointless busy work, isn't that why we become programmers in the first place?

If your intent is to make it a pure human-keyboard-code challenge, then I would have thought this would be a great opportunity to make the underlying questions harder, or to find the edge cases (in terms of input or question format) where LLMs are no help.

Re:Advent of Code 2023's new AI/LLM Policy by ps256 on Monday October 16, 2023 @12:24PM (#37902177)
> it starts to feel like pointless busy work

The point of AoC was always to practice something new, learn a couple of things, challenge yourself a bit, share solutions and ideas with people etc. I don't see how that's changed by the existence of LLMs or by this policy.

Re:Advent of Code 2023's new AI/LLM Policy by rpearl on Monday October 16, 2023 @12:14PM (#37901994)
Computers completely dominate humans in, say, chess. A game between humans is still interesting, though--and isn't nearly as interesting if one person cheats with an engine.

In the same way, a human competition in advent of code is an interesting challenge--and wouldn't be, if people cheat with AI solvers.

Re:Advent of Code 2023's new AI/LLM Policy by michaelt on Monday October 16, 2023 @12:32PM (#37902320)
> If an AI can do it instantly, it starts to feel like pointless busy work,

Isn't every coding competition pointless busywork? The organisers already know the solution, and even if they don't I can probably find a dozen solutions on github/reddit/wherever.

The point is you can enjoy it even though it's pointless busywork - much like you can enjoy doing a crossword, or running a marathon, or lifting a heavy weight in the gym.

Re:Advent of Code 2023's new AI/LLM Policy by jetrink on Monday October 16, 2023 @12:21PM (#37902118)
The way AoC is structured, the early questions are accessible to everyone, even brand new programmers and they become more difficult gradually. Making the questions more difficult or giving them tricky edge cases would reduce the number of people who could participate.

To get on the leader boards for the early questions is more a test of one's ability to work quickly and accurately than of one's problem solving skills. Machines will always excel there, so I think it makes sense to exclude them as tools.

Re:Advent of Code 2023's new AI/LLM Policy by Herbstluft on Monday October 16, 2023 @12:44PM (#37902539)
> If an AI can do it instantly, it starts to feel like pointless busy work

If you can't solve the problem in a few seconds/minutes you will be able to just look up or copy/paste the answer for every AoC day from the associated solutions thread.

So in other words if you view it like that there was already a better "tool" to very easily "solve" any AoC problem: internet search.

If all you care about is getting a number to put into the website to get a checkmark that is.

Re:Advent of Code 2023's new AI/LLM Policy by bensecure on Monday October 16, 2023 @12:56PM (#37902727)
Last year, when GPT-3 was already around, people managed to get it solve some of the earlier problems itself, but not the later problems. This makes sense, because the earlier problems are made deliberately easier, while more difficult problems are saved for later. To eliminate this "busy work" aspect would require knocking out those easier problems, which would be a loss for those who can't solve the later problems at all.

Even then, it seems like something being beatable by a computer doesn't make it pointless to do as an exercise. We still teach children to add and multiply, even though computers can do these things billions of times faster than a human can and have been able to do so for decades. We believe that being able to do these things in ones own head is valuable even if it isn't the fastest way of doing them. Besides, there are still many people who practice and enjoy chess even after computers beat humans at it, and in fact many people integrate computer chess programs into their practice and analysis of chess.

The advent of code problems are already "busy work", in the sense of not making much sense, and having numerous complexities thrown into them for the sake of it. People have still enjoyed them for the competitive aspect, or for the fun of solving a puzzle. Those aspects don't change when you introduce an AI that can solve them faster.