News for hackers. Stuff that matters.

A comment on AutoCodeRover resolves 22% of real-world GitHub issues in SWE-bench lite. Parent comment

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by prmph on Tuesday April 09, 2024 @09:54AM (#39979460)
Then how can you have confidence that it actually fixes the bug? It means you still need a human to review the fix, no?
[ Parent | on HN ]
Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by yuntong on Tuesday April 09, 2024 @11:00AM (#39980172)
The developer written testcases are provided in SWE-bench-lite so those could be used to check the generated patches.

The auto-generated patches are to reduce the effort of resolving issues. In practice, they should be reviewed and verified by human developers before they are integrated.

[ Parent | on HN ]