News for hackers. Stuff that matters.
Re:Inkling 2 Mini by coder543 on Friday November 20, 2026 @04:55PM (#50582836)
[delayed]
Re:Inkling 2 Mini by twothreeone on Friday November 20, 2026 @06:20PM (#50583775)
I think that's really the key here right? It doesn't really "beat" Qwen3.8-27B.. more of like it's on par / a few points ahead on some, behind on others. But contrary to the Qwen (which is dense) it actually does it as an MoE - so less active parameters.

And the fact that they trained it as a looped model in 4-bit native is also kind of impressive to me as well, because it combines recurrence, routing, and narrow-format - all of which adversely impact numeric stability during training.

Re:Inkling 2 Mini by dannyw on Friday November 20, 2026 @07:54PM (#50584577)
Beyond that, they detailed quite a bit of their training pipeline for Inkling 2 Small.

Apparently trained on a ~couple dozen trillion tokens; which is far smaller than most pretraining and posttraining runs.

Re:Inkling 2 Mini by reissbaker on Friday November 20, 2026 @11:17PM (#50585892)
It beats Qwen on effectively every coding benchmark, which I think are the most relevant ones to HN :)

On the other benchmarks it trades blows or beats Qwen; as Thinky points out, looping helps reasoning but doesn't scale memorization, so tasks requiring broad world knowledge without tools/search won't be helped by looping.

Still super impressive, and probably replaces Qwen 27B in pretty much any workload!

Re:Inkling 2 Mini by stymaar on Friday November 20, 2026 @11:42PM (#50586011)
I wonder if one could build a looping model with PLE but with different embedding loaded at different iterations of the same layer.