Re:Qwen4-Max
by irthomasthomas on Monday November 16, 2026 @08:23AM
(#50517362)
Not the very top, but Astra was behind Kimi K3.1 before AA's last change which boosted openai to second place. This has happened with every AA update.
[ Parent
| on HN ]
Re:Qwen4-Max
by fancyfredbot on Monday November 16, 2026 @11:42AM
(#50519616)
To be fair to them they still show Kimi as the best model at terminal bench 4, ahead of everyone else - fable, astra, carbon, etc.
For most things I'd use Kimi is probably better so the ranking is wrong for me.
However it also seems like in those benchmarks where Kimi underperformed it did do quite badly, whereas when Astra underperformed it did so less badly. How you reflect that into a single number I'm not sure - it's certainly difficult to get right and it doesn't seem obviously biased to me.