News for hackers. Stuff that matters.
Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by FeepingCreature on Wednesday June 05, 2024 @10:37AM (#40585345)
To be quite honest, I assume they made the restriction so that the models would fail.

This sort of paper is becoming a genre.

Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by nyrikki on Wednesday June 05, 2024 @10:54AM (#40585580)
You test models where they fail in any field.

The orbit of Mercury to discover GR as an example.

As all models are wrong, but some are useful, finding where they fail is how you figure out if they are useful.

As the 'AGI is near' camp has won the hype game, it is important to ground expectations for practical exploitation of the technology.

Over promising unabashed optimism is partly what caused the previous AI winters.

As the formal proof methods of mathematics proved impractical, counterexamples and the scientific method is what CS has used for decades.

Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by qsi on Wednesday June 05, 2024 @11:28AM (#40586093)
They used three different kinds of prompts with varying levels of restrictions, as described in the paper.

To be quite honest, I assume you made your comment so that you could dismiss the paper without reading it.

Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by FeepingCreature on Wednesday June 05, 2024 @03:46PM (#40589640)
That's a fair cop, I didn't read it.

The thing is that "LLM reasoning breaks down" simply did not surprise me enough that I thought it was worth clicking. Making LLMs fail is not hard. They're interesting for the ways that they work, not the (many, many) ways that they don't.

edit: I've had a look and I don't think any of their prompts are very good. They're certainly not how I'd write them if I wanted a current model to actually solve the problem.

The way to make me take a paper like this seriously would be if you set it up as an adversarial collaboration with a competent prompter, and that person agreed they couldn't make a generic prompt that solved the problem. "We tried three times and none worked" is not news, or at any rate not news about LLMs.

Re:Alice in Wonderland: Simple Tasks Showing Complete Reason... by detourdog on Wednesday June 05, 2024 @10:42AM (#40585409)
It is a proof of weakness in the current system. This makes sense and births new hypotheses.