Re:Language is not essential for the cognitive processes tha...
by fennecbutt on Tuesday October 22, 2024 @08:44AM
(#41913668)
I've tried it out and found that some models can answer the question if it's phrased right. And pretty much all models get it right if you also spell it out letter by letter to solve the problem you pointed out.
[ Parent
| on HN ]
Re:Language is not essential for the cognitive processes tha...
by ddingus on Tuesday October 22, 2024 @07:27PM
(#41919828)
Spelling it out works in my experience. So does asking it for a python program to solve the problem.
Re:Language is not essential for the cognitive processes tha...
by fennecbutt on Wednesday October 23, 2024 @08:40PM
(#41930741)
Yeah, it does teach me more about how LLMs work on the inside when it can't answer a plain English logic question like that, but I can provide it a code example and it can execute it step by step and get a correct answer; it's clearly been trained on enough JS that even a complex reduce + arrow function I watched kunoichi (am RP model nonetheless!) imaginary execute it step by step and arrive at a correct answer.
I think it's something like the counting parts of problems that current models are shaky with, and I imagine it's a training data problem.