News for hackers. Stuff that matters.
Re:The gauge broke: devs felt 20% faster with AI, measured 1... by verzali on Thursday July 02, 2026 @03:31AM (#48757811)
That post literally says the results are unreliable...
Re:The gauge broke: devs felt 20% faster with AI, measured 1... by lars512 on Thursday July 02, 2026 @03:36AM (#48757864)
...and in particular it says that one of the reasons is that developers are refusing to participate in the non-AI branch, and when they do, changing what tasks they select to those where AI would be less useful.

Overall this suggests to them that the current speedup is likely greater than what the study could measure.

Re:The gauge broke: devs felt 20% faster with AI, measured 1... by dofm on Thursday July 02, 2026 @03:53AM (#48757981)
It might suggest that but they can’t back it up because the study is broken and perhaps forever unrepeatable.

Like, what people are saying is, “That old study was wrong! They did a new broken study that overturned it!”