News for hackers. Stuff that matters.
Re:Qwen4-Max by namr2000 on Monday November 16, 2026 @08:08AM (#50517222)
If you're aiming to make the best possible small model, you still need to train a larger model and then do logit-level distillation from it. This is where most of the gains in small models have come from.

There are no comments on this comment yet.