News for hackers. Stuff that matters.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by egeozcan on Tuesday July 28, 2026 @11:39AM (#49085536)
I'd kindly suggest that we could also stop calling them "distillation attacks".
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by reilly3000 on Tuesday July 28, 2026 @11:44AM (#49085627)
Agreed. I think when it comes to light that Claude has been known to say “I’m DeepSeek” that everyone has had their hand in that cookie jar. Moreover, paying for API calls hardly seems like an attack; ToS violation to be certain but not in the same category of law as criminal activity like hacking.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by idiotsecant on Tuesday July 28, 2026 @12:39PM (#49086504)
wait, is there evidence of this? I've not observed it. It sounds like the kind of thing that I want to be true because it would be hilarious but that makes me suspicious.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by petu on Tuesday July 28, 2026 @01:23PM (#49087112)
LLMs can't reliably answer what they are (w/o getting that info from system prompt/tool call/etc), so yea.

https://xcancel.com/teortaxesTex/status/2026130112685416881

I think I've seen same happening with some European languages as well.

Re:Kimi Linear: An Expressive, Efficient Attention Architecture by snovv_crash on Tuesday July 28, 2026 @01:47PM (#49087444)
Ask it in Chinese
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by __MatrixMan__ on Tuesday July 28, 2026 @12:35PM (#49086444)
Agreed, "distilled variants" might be more suitable.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by overfeed on Tuesday July 28, 2026 @02:32PM (#49088018)
Calling them variants is also inaccurate when the pretrained base and architecture are completely different.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by halJordan on Tuesday July 28, 2026 @02:49PM (#49088243)
Why on earth wouldn't you? It's clearly a forcible, aggressive, non-consensual attempt to take something. That's an attack in any other terms. It's totally fair if you approve of the attack, and want the attack to succeed. But your preference doesn't stop it from being what it is.
Re:Kimi Linear: An Expressive, Efficient Attention Architecture by egeozcan on Tuesday July 28, 2026 @03:02PM (#49088401)
> It's clearly a forcible, aggressive, non-consensual attempt to take something

Distillers are not taking anything, they are just making their model learn from better ones - isn't that the whole AI training doesn't violate IP argument?

They just aren't using the tool in compliance with the terms of service. Anthropic could ban them or take them to court maybe. Not an attack still.

Re:Kimi Linear: An Expressive, Efficient Attention Architecture by nextaccountic on Tuesday July 28, 2026 @03:24PM (#49088687)
We could call it distillation learning

A model is teaching another here

Everyone wins

Re:Kimi Linear: An Expressive, Efficient Attention Architecture by anigbrowl on Tuesday July 28, 2026 @03:06PM (#49088456)
Fine, then let's refer to the initial data collection/training as 'compilation attacks' going forward.

...or maybe we stop defaulting to adversarial paradigms for every conceivable situation.

Re:Kimi Linear: An Expressive, Efficient Attention Architecture by Tostino on Tuesday July 28, 2026 @03:22PM (#49088659)
"They are using and paying for an API I am selling...But they save the data and use it for something I don't like! I'm being attacked."