Beyond that, they detailed quite a bit of their training pipeline for Inkling 2 Small.
Apparently trained on a ~couple dozen trillion tokens; which is far smaller than most pretraining and posttraining runs.
Re:Inkling 2 Mini
by reissbaker on Friday November 20, 2026 @11:17PM
(#50585892)
It beats Qwen on effectively every coding benchmark, which I think are the most relevant ones to HN :)
On the other benchmarks it trades blows or beats Qwen; as Thinky points out, looping helps reasoning but doesn't scale memorization, so tasks requiring broad world knowledge without tools/search won't be helped by looping.
Still super impressive, and probably replaces Qwen 27B in pretty much any workload!
And the fact that they trained it as a looped model in 4-bit native is also kind of impressive to me as well, because it combines recurrence, routing, and narrow-format - all of which adversely impact numeric stability during training.