News for hackers. Stuff that matters.
Re:30% Drop In o1-Preview Accuracy When Putnam Problems Are ... by lupire on Wednesday January 01, 2025 @10:09AM (#42566435)
The best human performance on that task required many many hours of private work given that input.

How much would ChatGPT charge for that much reasoning? Isn't cost quadratic in sort term working memory?

It would be more interesting to prompt it with X% of a new paper's logical argument, and see if it can predict the rest.

There are no comments on this comment yet.