News for hackers. Stuff that matters.
Re:Clef: Open-source decision models, and new RL fine-tuning... by SebastianSosa on Thursday October 01, 2026 @06:47PM (#49927950)
Public benchmarks are easy to cheat, if I am typesafe I would also release a public benchmark to distract otherwise competent people in overfitting to a benchmark instead of making something actually useful. Diogo very much is against public benchmarks ;)
Re:Clef: Open-source decision models, and new RL fine-tuning... by Foobar8568 on Friday October 02, 2026 @08:08AM (#49932578)
You take Qwen3.6 35b on a 5090rtx, and here you get a higher score than Jev, for 2sec more latency on average. So yeah it's not subsecond, but I am sure that if I had VC money, I could too get within 500ms too!