News for hackers. Stuff that matters.
Re:The Kimi K3 Moment by InsideOutSanta on Saturday July 18, 2026 @06:19PM (#48963017)
I'm assuming you posted that as evidence for the claim that "empirically, it appears that distillation of a more advanced model is a required first step", but I don't think it is. It's just evidence that Moonshot distills Anthropic's models, which, yes, they do.
Re:The Kimi K3 Moment by milkshakes on Saturday July 18, 2026 @06:34PM (#48963130)
it is not a required first step for training a model, sure. but that's not what i claimed. what i claimed is that is how they are so significantly _reducing the cost_ of training one! how else do you think they are doing it?