News for hackers. Stuff that matters.
Re:GPT-Synopsys: Frontier Intelligence to Revolutionize Chip... by PunchyHamster on Thursday October 01, 2026 @03:59PM (#49926367)
> Today's frontier models can't even handle 100% of the SWE benchmarks that have been around for longer than they've been training the models. Companies that are benchmaxxing their models against the benchmarks haven't even been able to get them to 100%.

Is average developer 100% the benchmarks ?

Re:GPT-Synopsys: Frontier Intelligence to Revolutionize Chip... by criemen on Thursday October 01, 2026 @05:07PM (#49927098)
Given how flawed the benchmarks are (see for example https://epoch.ai/benchmarks/deepswe/review), not even the mythical 10x developer is gonna get 100% on these benchmarks.