News for hackers. Stuff that matters.
Re:OK, I can partly explain the LLM chess weirdness now by wavemode on Friday November 22, 2024 @11:09AM (#42214955)
You can write scripts that correct bad math, too. In fact most of the time ChatGPT will just call out to a calculator function. This is a smart solution, and very useful for end users! But, still, we should not try to use that to make the claim that LLMs have a good understanding of math.
Re:OK, I can partly explain the LLM chess weirdness now by henryfjordan on Friday November 22, 2024 @12:55PM (#42215925)
At what point does "knows how to use a calculator" equate to knowing how to do math? Feels pretty close to me...
Re:OK, I can partly explain the LLM chess weirdness now by Tepix on Friday November 22, 2024 @01:00PM (#42215975)
Well, LLMs are bad at math but they're ok at detecting math and delegating it to a calculator program.

It's kind of like humans.

Re:OK, I can partly explain the LLM chess weirdness now by afro88 on Friday November 22, 2024 @01:20PM (#42216130)
If a script were applied that corrected "bad math" and now the LLM could solve complex math problems that you can't one-shot throw at a calculator, what would you call it?
Re:OK, I can partly explain the LLM chess weirdness now by sixfiveotwo on Friday November 22, 2024 @01:39PM (#42216279)
It's a good point.

But this math analogy is not quite appropriate: there's abstract math and arithmetic. A good math practitioner (LLM or human) can be bad at arithmetic, yet good at abstract reasoning. The later doesn't (necessarily) requires the former.

In chess, I don't think that you can build a good strategy if it relies on illegal moves, because tactics and strategies are tied.

Re:OK, I can partly explain the LLM chess weirdness now by danparsonson on Friday November 22, 2024 @07:23PM (#42218429)
If I had wings, I'd be a bird.

Applying a corrective script to weed out bad answers is also not "one-shot" solving anything, so I would call your example an elaborate guessing machine. That doesn't mean it's not useful, but that's not how a human being does maths, when they understand what they're doing - in fact you can readily program a computer to solve general maths problems correctly the first time. This is also exactly the problem with saying that LLMs can write software - a series of elaborate guesses is undeniably useful and impressive, but without a corrective guiding hand, ultimately useless, and not demonastrating generalised understanding of the problem space. The dream of AI is surely that the corrective hand is unnecessary?

Re:OK, I can partly explain the LLM chess weirdness now by at_a_remove on Friday November 22, 2024 @11:48PM (#42219262)
Then you could replace the LLM with a much cheaper RNG and let it guess until the "bad math filter" let something through.

I was once asked by one of the Clueless Admin types if we couldn't just "fix" various sites such that people couldn't input anything wrong. Same principle.

Re:OK, I can partly explain the LLM chess weirdness now by vunderba on Friday November 22, 2024 @01:26PM (#42216178)
Agreed. It's not the same thing and we should strive for precision (LLMs are already opaque enough as it is).

An LLM that recognizes an input as "math" and calls out to a NON-LLM to solve the problem vs an LLM that recognizes an input as "math" and also uses next-token prediction to produce an accurate response ARE DIFFERENT.