News for hackers. Stuff that matters.
Re:GPT-5 by tylermw on Thursday August 07, 2025 @01:17PM (#44827304)
What's going on with this plot's y-axis?

https://bsky.app/profile/tylermw.com/post/3lvtac5hues2n

Re:GPT-5 by haffi112 on Thursday August 07, 2025 @01:28PM (#44827501)
It makes it look like the presentation is rushed or made last minute. Really bad to see this as the first plot in the whole presentation. Also, I would have loved to see comparisons with Opus 4.1.

Edit: Opus 4.1 scores 74.5% (https://www.anthropic.com/news/claude-opus-4-1). This makes it sound like Anthropic released the upgrade to still be the leader on this important benchmark.

Re:GPT-5 by danpalmer on Thursday August 07, 2025 @02:06PM (#44828149)
> like the presentation is rushed or made last minute

Or written by GPT-5?

Re:GPT-5 by herval on Thursday August 07, 2025 @10:30PM (#44832797)
They never compare with other vendors
Re:GPT-5 by rrrrrrrrrrrryan on Thursday August 07, 2025 @01:19PM (#44827351)
This is hilarious
Re:GPT-5 by moritzwarhier on Thursday August 07, 2025 @01:31PM (#44827551)
Probably created without thinking enabled. Lower % accuracy ensues, speaking from experience.
Re:GPT-5 by silverquiet on Thursday August 07, 2025 @01:23PM (#44827419)
Probably generated by AI.
Re:GPT-5 by Sateeshm on Thursday August 07, 2025 @01:26PM (#44827459)
If not, the person that made the chart just got $1.5M
Re:GPT-5 by lysecret on Thursday August 07, 2025 @01:18PM (#44827333)
Couldn’t believe it was real haha
Re:GPT-5 by artemonster on Thursday August 07, 2025 @01:22PM (#44827392)
[flagged]
Re:GPT-5 by dang on Thursday August 07, 2025 @02:04PM (#44828117)
Please don't post like this to Hacker News, regardless of how idiotic other people are or you feel they are.

You may not owe people who you feel are idiots better, but you owe this community better if you're participating in it.

https://news.ycombinator.com/newsguidelines.html

Re:GPT-5 by ozgung on Thursday August 07, 2025 @05:56PM (#44830870)
Also this coding deception rate bar tries to decieve us.

https://imgur.com/a/QkriFco

Re:GPT-5 by ileonichwiesz on Friday August 08, 2025 @12:04PM (#44838590)
It’s beyond parody that they did something like this on a slide about deception. You couldn’t make this stuff up.
Re:GPT-5 by TrackerFF on Friday August 08, 2025 @03:19AM (#44834422)
After reading around, it seems like they probably forgot to update/swap the slides before presentation. The graphs were correct on their website, as they launched. But the ones they used in the presentation were probably some older versions they had forgotten to fix.