Re:The Kimi K3 Moment
by margalabargala on Saturday July 18, 2026 @05:38PM
(#48962698)
Their point is that "training" and "distillation" are essentially the same. The difference between the words is whether the source material is output from another model, vs being some original text.
To succinctly restate my point, you cannot distill a model from information because the model is not contained within that information. You can distill a model from another model.