Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ...
by Eisenstein on Wednesday January 01, 2025 @07:36PM
(#42570544)
Except that Claude often takes into account things it thinks might be typos.
This is not code. Forgetting a semi colon will not make the output break. It thinks 'maybe they wrote he instead of she' and then gives options for both situations.
It is meant to solve real world situations where people might not type properly, it is not a word problem solving machine.
This is not code. Forgetting a semi colon will not make the output break. It thinks 'maybe they wrote he instead of she' and then gives options for both situations.
It is meant to solve real world situations where people might not type properly, it is not a word problem solving machine.