News for hackers. Stuff that matters.
Re:OpenAI dropped the price of o3 by 80% by resters on Tuesday June 10, 2025 @02:58PM (#44240142)
It's probably optimized in some way, but if the optimizations degrade performance, let's hope it is reflected in various benchmarks. One alternative hypothesis is that it's the same model, but in the early days they make it think "harder" and run a meta-process to collect training data for reinforcement learning for use on future models.
Re:OpenAI dropped the price of o3 by 80% by SparkyMcUnicorn on Tuesday June 10, 2025 @03:11PM (#44240298)
It's a bit dated now, but it would be cool if people submitted PRs for this one: https://aider.chat/docs/leaderboards/by-release-date.html
Re:OpenAI dropped the price of o3 by 80% by __mharrison__ on Tuesday June 10, 2025 @04:02PM (#44240838)
Dated? This was updated yesterday https://aider.chat/docs/leaderboards/
Re:OpenAI dropped the price of o3 by 80% by SparkyMcUnicorn on Tuesday June 10, 2025 @06:18PM (#44242107)
My link is to the benchmark results _over time_.

The main leaderboard page that you linked to is updated quite frequently, but it doesn't contain multiple benchmarks for the same exact model.