News for hackers. Stuff that matters.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by csomar on Thursday January 02, 2025 @05:23AM (#42573268)
gpt-3.5-turbo at 0 temperature:

> The 10.01-pound bag of fluffy cotton is heavier than the 9.99-pound bag of steel ingots.

Interestingly, that was the best answer out of all models and also a correct one. O1-preview doesn't allow setting the temperature, so it's hard to know where the real probabilities fall.

There are no comments on this comment yet.