Re:Inkling 2 Mini
by coder543 on Friday November 20, 2026 @04:55PM
(#50582836)
[delayed]
[ Parent
| on HN ]
Re:Inkling 2 Mini
by twothreeone on Friday November 20, 2026 @06:20PM
(#50583775)
I think that's really the key here right? It doesn't really "beat" Qwen3.8-27B.. more of like it's on par / a few points ahead on some, behind on others. But contrary to the Qwen (which is dense) it actually does it as an MoE - so less active parameters.
And the fact that they trained it as a looped model in 4-bit native is also kind of impressive to me as well, because it combines recurrence, routing, and narrow-format - all of which adversely impact numeric stability during training.
Beyond that, they detailed quite a bit of their training pipeline for Inkling 2 Small.
Apparently trained on a ~couple dozen trillion tokens; which is far smaller than most pretraining and posttraining runs.
Re:Inkling 2 Mini
by reissbaker on Friday November 20, 2026 @11:17PM
(#50585892)
It beats Qwen on effectively every coding benchmark, which I think are the most relevant ones to HN :)
On the other benchmarks it trades blows or beats Qwen; as Thinky points out, looping helps reasoning but doesn't scale memorization, so tasks requiring broad world knowledge without tools/search won't be helped by looping.
Still super impressive, and probably replaces Qwen 27B in pretty much any workload!