News for hackers. Stuff that matters.
Re: by stingraycharles on Monday May 11, 2026 @07:47AM (#48093781)
That’s probably more work than the entire repo itself. Would need to be something like SWE-bench with and without “adamsreview”.

You’re right though, but evals are actually fairly tricky to write and maintain.

There are no comments on this comment yet.