News for hackers. Stuff that matters.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by Izkata on Wednesday January 01, 2025 @03:30PM (#42569045)
Yeah, this is the original version of this riddle. People who don't know it think the trick is that people will reflexively say the metal is heavier instead of "they're the same", when it actually goes deeper.

No idea if GP did it intentionally to further drift from training data, but steel doesn't count as a precious metal, so it messes up the riddle by putting the two weights in the same system.

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by zahlman on Wednesday January 01, 2025 @05:36PM (#42569885)
> Yeah, this is the original version of this riddle. People who don't know it think the trick is that people will reflexively say the metal is heavier instead of "they're the same"

...Have you really never encountered people who would reflexively say that?

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by Izkata on Wednesday January 01, 2025 @07:50PM (#42570619)
That's not what I said. I'm talking about the riddle itself, not how people react to it.