how many of the "fixes" were to code that wasn't broken? The prompt tells the model there are bugs, and these models are eager to please, so I'd expect plenty of confident edits to working code. The original test suite only catches the ones that break something. Precision next to recall would make the leaderboard a lot more useful.