Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Semgrep: GLM 5.2 beats Claude in our Cyber Benchmarks. Parent comment
Same for me, I certainly don't have the same definition of success and failure either.
A more expensive model has *less* rooms for wandering around than a cheaper model.
If Claude wanders around during 10min until finding the most obvious solution, then I count it as a failure.
There are no comments on this comment yet.
Same for me, I certainly don't have the same definition of success and failure either.
A more expensive model has *less* rooms for wandering around than a cheaper model.
If Claude wanders around during 10min until finding the most obvious solution, then I count it as a failure.