AutoCodeRover resolves 22% of real-world GitHub issues in SWE-bench lite

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by abhikrc on Tuesday April 09, 2024 @09:09AM (#39979055)

No it does not need an unit test to work. We responded to another similar question from another user.

[ Parent | on HN ]

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by prmph on Tuesday April 09, 2024 @09:54AM (#39979460)

Then how can you have confidence that it actually fixes the bug? It means you still need a human to review the fix, no?

[ Parent | on HN ]

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by yuntong on Tuesday April 09, 2024 @11:00AM (#39980172)

The developer written testcases are provided in SWE-bench-lite so those could be used to check the generated patches.

The auto-generated patches are to reduce the effort of resolving issues. In practice, they should be reviewed and verified by human developers before they are integrated.

[ Parent | on HN ]

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by rrr_oh_man on Tuesday April 09, 2024 @01:13PM (#39981598)

Thank you for the clarification. And shame on me for talking out of my ass!

[ Parent | on HN ]