News for hackers. Stuff that matters.
Re:GPT-5 on SWE-bench: Cost and performance deep-dive by lieret on Friday August 08, 2025 @12:57PM (#44839226)
I think gpt-5-mini should really help them. At least from these benchmark scores, there probably shouldn't be a huge performance degradation for letting gpt-5-mini drive most of the workflow. Of course users might still want to just run with latest and greatest (but still gpt-5 will be cheaper I think)

There are no comments on this comment yet.