News for hackers. Stuff that matters.
Re:MAI Code 2 and Code 2 Flash by eldenring on Tuesday November 17, 2026 @03:00PM (#50537277)
I disagree, I think distillation hides the true technical advantage since you can always get within X% of Claude by ex: training on newly created code on Github, but the underlying intelligence is harder to replicate.
Re:MAI Code 2 and Code 2 Flash by markasoftware on Tuesday November 17, 2026 @03:02PM (#50537305)
based on the behavior of the chinese labs it seems like training on chain-of-thought is extremely important for distillation, and you can't get that by training on llm generated text.