News for hackers. Stuff that matters.

A comment on 30% Drop In o1-Preview Accuracy When Putnam Problems Are Slightly Variated. Parent comment

Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by mycall on Thursday January 02, 2025 @12:15PM (#42576308)
Did you try it more than once per model? I could see temperature or other similar gradients providing wrong answers.
[ Parent | on HN ]

There are no comments on this comment yet.