Re:AutoCodeRover resolves 22% of real-world GitHub issues in...
by falcor84 on Tuesday April 09, 2024 @08:35AM
(#39978738)
It would help if you were to provide a specific example or two
[ Parent
| on HN ]
Re:AutoCodeRover resolves 22% of real-world GitHub issues in...
by arp242 on Tuesday April 09, 2024 @10:57AM
(#39980141)
You can't demonstrate whether a dataset is representative or not by "an example or two". You need to look at all the data.
And all of this is fine. It's just a benchmark suit and doesn't need to be fully representative. The dataset itself doesn't even claim to be that as far as I can find. All I'm saying that the title wasn't really accurate.