News for hackers. Stuff that matters.
Re:GitHub Copilot Coding Agent by worldsayshi on Monday May 19, 2025 @04:08PM (#44034247)
I do agree that some scepticism is due here but how can we tell if we're treading into "moving the goal posts" territory?
Re:GitHub Copilot Coding Agent by overfeed on Monday May 19, 2025 @04:47PM (#44034684)
I'd love to know where you think the starting position of the goal posts was.

Everyone who has used AI coding tools interactively or as agents knows they're unpredictably hit or miss. The old, non-agent Copilot has a dashboard that shows org-wide rejection rates for for paying customers. I'm curious to learn what the equivalent rejection-rate for the agent is for the people who make the thing.

Re:GitHub Copilot Coding Agent by taurath on Monday May 19, 2025 @11:00PM (#44037352)
I think the implied promise of the technology, that it is capable of fundamentally changing organizations relationships with code and software engineering, deserves deep understanding. Companies will be making multi million dollar decisions based on their belief in its efficacy
Re:GitHub Copilot Coding Agent by internet101010 on Tuesday May 20, 2025 @09:23AM (#44041334)
When someone says that the number given is not high enough. I wouldn't consider trying to get an understanding of PR acceptance rate before and after Copilot to be moving the goal posts. Using raw numbers instead of percentages is often done to emphasize a narrative rather than simply inform (e.g. "Dow plummets x points" rather than "Dow lost 1.5%").