News for hackers. Stuff that matters.
Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA by linkregister on Tuesday July 21, 2026 @07:24PM (#48999742)
I'm happy that Kimi K3 is indeed SotA and its open weights are due to be released soon.

It's also true that Moonshot and other labs distill from Claude. This has been reported on extensively. I don't think there's any alpha for Anthropic distilling from this model. I do not mean to discount the tremendous amount of innovation regarding MoE and quantization that Moonshot has accomplished. But its training with synthetic data is essentially distillation from frontier labs.

Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA by fnordpiglet on Tuesday July 21, 2026 @07:55PM (#49000014)
When I say distill I also mean mine it architecturally for insights but I doubt seriously the model training is entirely distillation of Claude, it’s almost certainly a mixture of both original corpus and reinforcement as well as distillation. I think it’s a little condescending to imply that these new open models are cheap ripoffs with nothing original to them. These teams and labs are top tier as well, working under unreasonable constraints imposed by the USG. That’s a powerful combination for creativity.
Re:Kimi K3 Is Competitive with Fable; Kimi K3 and Fable Is SoTA by linkregister on Tuesday July 21, 2026 @08:53PM (#49000434)
I think your characterization of my post, which credits Moonshot's innovation, goes a bit too far.