News for hackers. Stuff that matters.

A comment on Kimi K3.1 Pro weights out. Parent comment

Re:Kimi K3.1 Pro weights out by JacobAsmuth on Wednesday November 04, 2026 @04:38PM (#50371926)
Hypothesis for why K3.1 dropped so much in relative position to other models when AA switched to private evals? Primarily FrontierCode, CritPt V2, and the new private version of AA Omniscience where the model massively underperforms relative to its performance on public benchmarks?
[ Parent | on HN ]
Re:Kimi K3.1 Pro weights out by dmckinno on Thursday November 05, 2026 @09:31PM (#50387413)
I should have been a bit more precise. The model is obviously benchmaxxed compared to the western closed models, but it is not compared to the OSS competitors.

I think the AA rescoring reflects that as well. Kimi is still in the mix with the tail end of the best models and far ahead of DS, GLM, etc.

And the new AA index is obviously wonky in its own way. There is no way Haiku is outperforming Grok 4.7.

[ Parent | on HN ]