News for hackers. Stuff that matters.

A comment on Google's Genie is more impressive than GPT5. Parent comment

Re:Google's Genie is more impressive than GPT5 by JimDabell on Friday August 08, 2025 @01:28PM (#44839531)
> This is an incorrect interpretation. The benchmark which the betting market is based upon currently ranks Gemini 2.5 higher than GPT-5.

You can see from the graph that Google shot way up from ~25% to ~80% upon the release of GPT-5. Google’s model didn’t suddenly get way better at any benchmarks, did it?

[ Parent | on HN ]
Re:Google's Genie is more impressive than GPT5 by dcre on Friday August 08, 2025 @01:51PM (#44839728)
It's not about Google's model getting better. It is that gpt-5 already has a worse score than Gemini 2.5 Pro had before gpt-5 came out (on the particular metric that determines this bet: Overall Text without Style Control).

https://lmarena.ai/leaderboard/text/overall-no-style-control

That graph is a probability. The fact that it's not 100% reflects the possibility that gpt-5 or someone else will improve enough by the end of the month to beat Gemini.

[ Parent | on HN ]