News for hackers. Stuff that matters.
Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by TeMPOraL on Thursday June 25, 2026 @09:47AM (#48673330)
DeepSeek R1 was a famous case - not only it briefly beat then-SOTA on the cheap, it was also released with distilled versions that preserved bulk of the improvements but could be run on higher-end consumer hardware.

And of course Gemma models are said to be distillations of Gemini.

Re:Anthropic Accuses Alibaba of 'Illicitly' Accessing AI Models by epolanski on Thursday June 25, 2026 @10:06AM (#48673637)
The distillation you're talking about is about cutting the number of weights, it has nothing to do with extracting QAs from another model.