News for hackers. Stuff that matters.

A comment on MaxxBench – "Nice DeepSWE score. But is it true?".

Re:MaxxBench – "Nice DeepSWE score. But is it true?" by eden-u4 on Sunday November 08, 2026 @06:37AM (#50412381)
How is it different from SlopCode Bench? Isn't this a change in spec after the first prompt as in SlopCode Bench?
[ Parent | on HN ]
Re:MaxxBench – "Nice DeepSWE score. But is it true?" by dgacmu on Sunday November 08, 2026 @06:25PM (#50418780)
No, this modified the original prompt, it didn't do a multi-round evaluation like slop code. It was a little hard to get that from the writeup, I had the same initial reaction.
[ Parent | on HN ]