Re:OpenAI Announces New SWE-Lancer Benchmark
by bufferoverflow on Tuesday February 18, 2025 @01:11PM
(#43093083)
And how do you evaluate if the task was completed correctly? There are nearly infinite ways to solve a given software dev problem, if the problem isn't trivial (and I hope they are not benchmarking trivial problems).
[ Parent
| on HN ]