But whether $THING should be adopted and whether it does increase long-term productivity is nowhere near as clear-cut.
Ironically you could get the same effect and save compute fees by simply having programmers stay home one day a week.
[1] https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
> We do not provide evidence that: AI systems do not currently speed up many or most software developers
> Most alarmingly, the METR study found experienced developers took 19% longer with AI tools, despite believing they’d sped up by 20%.
> We do not provide evidence that: AI systems do not currently speed up many or most software developers
You act like that's a "gotcha" instead of a normal thing. All they mean by that [0] is that can't mathematically prove their developers/tasks/tool are representative for of the majority of worldwide developers/tasks/tools.
You're demanding an unreasonable level of investment for anyone to "prove a negative."
The burden of proof lies on the people claiming zillion-fold boosts in productivity. This especially true because they could profit in the process, as opposed to just burning money to prove a point.
[0] https://metr.org/blog/2025-07-10-early-2025-ai-experienced-o...
That said, I think LLMs will have a bigger effect than a self-balancing scooter, both positively and negatively.
> We do not provide evidence that: AI systems do not currently speed up many or most software developers