Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
by skeledrew on Tuesday July 21, 2026 @07:38PM
(#48999860)
The closed labs don't really benefit unless the open model has something extra they don't have though. Meanwhile the open model dilutes their customer base and seriously cheapens their offering (which is a heck of a good though IMO).
Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
by fnordpiglet on Tuesday July 21, 2026 @07:52PM
(#48999989)
Because the open model might have been distilled from outputs of the closed model doesn’t mean they are architecturally equivalent. There is almost certainly innovations in architecture present in the open models that the closed labs didn’t think of. It also is almost certainly true that they aren’t completely built out of a distilled corpus, that reinforcement is equivalent, etc. Therefore closed labs will also benefit from being able to inspect in totality the architecture, activations, weights, and be able to train against it at scale in an ensemble of other models and their internal work.
The only way there is no benefit would be is if the open models are literal copies of the closed model, which unless there was direct theft, is highly improbable.
Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
by linkregister on Tuesday July 21, 2026 @07:24PM
(#48999742)
I'm happy that Kimi K3 is indeed SotA and its open weights are due to be released soon.
It's also true that Moonshot and other labs distill from Claude. This has been reported on extensively. I don't think there's any alpha for Anthropic distilling from this model. I do not mean to discount the tremendous amount of innovation regarding MoE and quantization that Moonshot has accomplished. But its training with synthetic data is essentially distillation from frontier labs.
Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
by fnordpiglet on Tuesday July 21, 2026 @07:55PM
(#49000014)
When I say distill I also mean mine it architecturally for insights but I doubt seriously the model training is entirely distillation of Claude, it’s almost certainly a mixture of both original corpus and reinforcement as well as distillation. I think it’s a little condescending to imply that these new open models are cheap ripoffs with nothing original to them. These teams and labs are top tier as well, working under unreasonable constraints imposed by the USG. That’s a powerful combination for creativity.
Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA
by linkregister on Tuesday July 21, 2026 @08:53PM
(#49000434)
I think your characterization of my post, which credits Moonshot's innovation, goes a bit too far.
The future is good and better for everyone the more work is in the open and the more work is in the commercial space. It’s good all around.