News for hackers. Stuff that matters.
Re:Gemini 2.5 Flash by ein0p on Thursday April 17, 2025 @05:17PM (#43722303)
66.8% error rate reduction for o4-mini on AIME2025, and 21% error rate reduction on MMMU isn't "slightly higher". It'll be quite noticeable in practice.

There are no comments on this comment yet.