News for hackers. Stuff that matters.
Re:When AI Thinks It Will Lose, It Sometimes Cheats, Study F... by semi-extrinsic on Saturday February 22, 2025 @12:34PM (#43141094)
> The silliest position, though, is a gnostic "no reasoning here" position.

On the contrary - extraordinary claims require extraordinary evidence. That LLMs are performing a cognitive process similar to reasoning or intelligence is certainly an extraordinary claim, at least outside of VC hype circles. Making the model split its outputs into "answer" and "scratchpad", and then observing that these to parts are correlated, does not constitute extraordinary evidence.

Re:When AI Thinks It Will Lose, It Sometimes Cheats, Study F... by og_kalu on Saturday February 22, 2025 @03:30PM (#43142897)
>That LLMs are performing a cognitive process similar to reasoning or intelligence is certainly an extraordinary claim.

It's not an extraordinary claim if the processes are achieving similar things under similar conditions. In fact, the extraordinary claim then becomes that it is not in fact reasoning or intelligent.

Forces are required to move objects. If i saw something i thought was incapable of producing forces moving objects then the extraordinary claim starts being, "this thing cannot produce forces" not "this thing can move objects".

Re:When AI Thinks It Will Lose, It Sometimes Cheats, Study F... by semi-extrinsic on Saturday February 22, 2025 @04:27PM (#43143424)
Nope, that's not how it works. Correlation has never been proof of anything, despite how badly people want to believe so.
Re:When AI Thinks It Will Lose, It Sometimes Cheats, Study F... by og_kalu on Saturday February 22, 2025 @04:37PM (#43143516)
It's not about correlation or proving anything.

It's that something doing what you ascertained it never could changes what claims are and aren't extraordinary. You can handwave it away, i.e "the thing is moving objects by magic instead" but it's there and you can't keep acting like "this thing can produce forces" is still the extraordinary claim.