News for hackers. Stuff that matters.
Re:Gemini 3.5 Flash by golfer on Tuesday May 19, 2026 @03:04PM (#48197844)
Arena.ai:

> Gemini 3.5 Flash’s pricing shifts the Pareto frontier in Text. 8 models from GoogleDeepMind dominate the Text Arena Pareto curve where only 4 labs are represented for top performance in their price tiers.

https://x.com/arena/status/2056793180998361233

Re:Gemini 3.5 Flash by h14h on Tuesday May 19, 2026 @03:56PM (#48198607)
Given how widely varying the amount of tokens each model uses for a given task, "price-per-token" is essentially meaningless when doing this sort of comparison.

Artificial Analysis's "Cost to run" model (aka num_tokens_used * price_per_token) is much better, but even that is likely problematic since it's not clear whether running a bunch of benchmarks maps cleanly to real-world token use.

Re:Gemini 3.5 Flash by ohlookcake on Wednesday May 20, 2026 @03:07AM (#48204156)
That graph seems odd. It looks like Gemini 3.5 Flash is not actually on the convex hull, and they forced the 'frontier' to bend inwards to include it