News for hackers. Stuff that matters.

A comment on Kimi-K3 Releases on HuggingFace 7/27. Parent comment

Re:Kimi-K3 Releases on HuggingFace 7/27 by m00dy on Monday July 27, 2026 @05:57AM (#49067293)
The latter is a joke
[ Parent | on HN ]
Re:Kimi-K3 Releases on HuggingFace 7/27 by user43928 on Monday July 27, 2026 @06:07AM (#49067364)
I saw that it runs GPQA Diamond and TAU-Bench Airline and shows the results over a 32 day rolling average.

Other than that they track Tool call error rate and Structured output error rate.

I only discovered this today, and it seems like a good idea. What are the problems in practice?

[ Parent | on HN ]