AutoCodeRover resolves 22% of real-world GitHub issues in SWE-bench lite

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by dboreham on Tuesday April 09, 2024 @08:26AM (#39978667)

What's actually going on here? I watched the video of the example problem solution and it looks like either magic or fake. It doesn't produce the same PR as the real bug fix.

[ Parent | on HN ]

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by abhikrc on Tuesday April 09, 2024 @08:34AM (#39978737)

The entire setup is available for inspection from

https://github.com/nus-apr/auto-code-rover

Please try it out and send emails to the contact emails in this webpage, if you have any questions.

[ Parent | on HN ]

Re:AutoCodeRover resolves 22% of real-world GitHub issues in... by dboreham on Tuesday April 09, 2024 @09:42AM (#39979351)

Ok thanks. I haven't run it yet, but this does tell me that it's using OpenAI.

Is it expected to be able to solve arbitrary (simple) bugs, or only the list of bugs in the benchmark set?

[ Parent | on HN ]