News for hackers. Stuff that matters.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by scratchyone on Wednesday January 01, 2025 @09:24PM (#42571060)
fwiw i think reasoning models have at least solved this. even the smallest reasoning model, o1-mini, gets it right first try on my test:

  A 10.01-pound bag of fluffy cotton is heavier than a 9.99-pound bag of steel ingots. Despite the significant difference in density and volume between steel and cotton, the weights provided clearly indicate that the cotton bag has a greater mass.

  Summary:

  Steel ingots: 9.99 pounds
  Fluffy cotton: 10.01 pounds
  Conclusion: The 10.01-pound bag of cotton is heavier.

There are no comments on this comment yet.