Re:Clef: Open-source decision models, and new RL fine-tuning...
by SebastianSosa on Thursday October 01, 2026 @06:47PM
(#49927950)
Public benchmarks are easy to cheat, if I am typesafe I would also release a public benchmark to distract otherwise competent people in overfitting to a benchmark instead of making something actually useful.
Diogo very much is against public benchmarks ;)
[ Parent
| on HN ]
Re:Clef: Open-source decision models, and new RL fine-tuning...
by Foobar8568 on Friday October 02, 2026 @08:08AM
(#49932578)
You take Qwen3.6 35b on a 5090rtx, and here you get a higher score than Jev, for 2sec more latency on average.
So yeah it's not subsecond, but I am sure that if I had VC money, I could too get within 500ms too!