News for hackers. Stuff that matters.
Re:Claude Opus 4.6 by smokel on Thursday February 05, 2026 @02:25PM (#46903862)
I'll bite. The benchmark is actually pretty good. It shows in an extremely comprehensible way how far LLMs have come. Someone not in the know has a hard time understanding what 65.4% means on "Terminal-Bench 2.0". Comparing some crappy pelicans on bicycles is a lot easier.
Re:Claude Opus 4.6 by blibble on Thursday February 05, 2026 @03:50PM (#46905093)
it ceases to be a useful benchmark of general ability when you post it publicly for them to train against