News for hackers. Stuff that matters.

A comment on Reasoning models don't always say what they think. Parent comment

Re:Reasoning models don't always say what they think by kelseyfrog on Thursday April 03, 2025 @02:58PM (#43573871)
It's even worse - the more we believe ourselves to be rational, the bigger blind spot we have for our own rationalizing behavior. The best way to increase rationality is to believe oneself to be rationalizing!

It's one of the reasons I don't trust bayesians who present posteriors and omit priors. The cargo cult rigor blinds them to their own rationalization in the highest degree.

[ Parent | on HN ]
Re:Reasoning models don't always say what they think by guerrilla on Thursday April 03, 2025 @03:46PM (#43574469)
Any links to the research on this?
[ Parent | on HN ]
Re:Reasoning models don't always say what they think by drowsspa on Thursday April 03, 2025 @04:42PM (#43575128)
Yeah, rationality is a bug of our brain, not a feature. Our brain just grew so much that now we can even use it to evaluate maths and logical expressions. But it's not its primary mode of operation.
[ Parent | on HN ]