Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by egeozcan on Tuesday July 28, 2026 @11:39AM
(#49085536)
I'd kindly suggest that we could also stop calling them "distillation attacks".
[ Parent
| on HN ]
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by reilly3000 on Tuesday July 28, 2026 @11:44AM
(#49085627)
Agreed. I think when it comes to light that Claude has been known to say “I’m DeepSeek” that everyone has had their hand in that cookie jar. Moreover, paying for API calls hardly seems like an attack; ToS violation to be certain but not in the same category of law as criminal activity like hacking.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by idiotsecant on Tuesday July 28, 2026 @12:39PM
(#49086504)
wait, is there evidence of this? I've not observed it. It sounds like the kind of thing that I want to be true because it would be hilarious but that makes me suspicious.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by petu on Tuesday July 28, 2026 @01:23PM
(#49087112)
LLMs can't reliably answer what they are (w/o getting that info from system prompt/tool call/etc), so yea.
https://xcancel.com/teortaxesTex/status/2026130112685416881
I think I've seen same happening with some European languages as well.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by snovv_crash on Tuesday July 28, 2026 @01:47PM
(#49087444)
Ask it in Chinese
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by __MatrixMan__ on Tuesday July 28, 2026 @12:35PM
(#49086444)
Agreed, "distilled variants" might be more suitable.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by overfeed on Tuesday July 28, 2026 @02:32PM
(#49088018)
Calling them variants is also inaccurate when the pretrained base and architecture are completely different.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by halJordan on Tuesday July 28, 2026 @02:49PM
(#49088243)
Why on earth wouldn't you? It's clearly a forcible, aggressive, non-consensual attempt to take something. That's an attack in any other terms. It's totally fair if you approve of the attack, and want the attack to succeed. But your preference doesn't stop it from being what it is.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by egeozcan on Tuesday July 28, 2026 @03:02PM
(#49088401)
> It's clearly a forcible, aggressive, non-consensual attempt to take something
Distillers are not taking anything, they are just making their model learn from better ones - isn't that the whole AI training doesn't violate IP argument?
They just aren't using the tool in compliance with the terms of service. Anthropic could ban them or take them to court maybe. Not an attack still.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by nextaccountic on Tuesday July 28, 2026 @03:24PM
(#49088687)
We could call it distillation learning
A model is teaching another here
Everyone wins
Re:Kimi Linear: An Expressive, Efficient Attention Architecture
by anigbrowl on Tuesday July 28, 2026 @03:06PM
(#49088456)
Fine, then let's refer to the initial data collection/training as 'compilation attacks' going forward.
...or maybe we stop defaulting to adversarial paradigms for every conceivable situation.