It makes it look like the presentation is rushed or made last minute. Really bad to see this as the first plot in the whole presentation. Also, I would have loved to see comparisons with Opus 4.1.
Edit: Opus 4.1 scores 74.5% (https://www.anthropic.com/news/claude-opus-4-1). This makes it sound like Anthropic released the upgrade to still be the leader on this important benchmark.
> like the presentation is rushed or made last minute
Or written by GPT-5?
They never compare with other vendors
Re:GPT-5
by rrrrrrrrrrrryan on Thursday August 07, 2025 @01:19PM
(#44827351)
This is hilarious
Re:GPT-5
by moritzwarhier on Thursday August 07, 2025 @01:31PM
(#44827551)
Probably created without thinking enabled. Lower % accuracy ensues, speaking from experience.
Re:GPT-5
by silverquiet on Thursday August 07, 2025 @01:23PM
(#44827419)
Probably generated by AI.
If not, the person that made the chart just got $1.5M
Couldn’t believe it was real haha
Re:GPT-5
by artemonster on Thursday August 07, 2025 @01:22PM
(#44827392)
[flagged]
Please don't post like this to Hacker News, regardless of how idiotic other people are or you feel they are.
You may not owe people who you feel are idiots better, but you owe this community better if you're participating in it.
Also this coding deception rate bar tries to decieve us.
Re:GPT-5
by ileonichwiesz on Friday August 08, 2025 @12:04PM
(#44838590)
It’s beyond parody that they did something like this on a slide about deception. You couldn’t make this stuff up.
After reading around, it seems like they probably forgot to update/swap the slides before presentation. The graphs were correct on their website, as they launched. But the ones they used in the presentation were probably some older versions they had forgotten to fix.
https://bsky.app/profile/tylermw.com/post/3lvtac5hues2n