Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ...
by bufferoverflow on Wednesday January 01, 2025 @11:30AM
(#42567020)
You wrote "back" instead of "bag".
[ Parent
| on HN ]
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ...
by collinvandyck76 on Wednesday January 01, 2025 @12:08PM
(#42567346)
Ah, good catch -- I had just copied the OP. Changing it to bag instead of back doesn't seem to change much. It still oscillates between the right and wrong answer, versus qualifying the 10.01 value as pounds, which has not yet given me the wrong answer (small sample size, of course).