News for hackers. Stuff that matters.
Re:Nvidia buying AI chip startup Groq for about $20B by tensor on Thursday December 25, 2025 @12:25AM (#46382303)
No, distillation is far older than deepseek. Deepseek was impressive because of algorithmic improvements that allowed them to train a model of that size with vastly less compute than anyone expected, even using distillation.

I also haven’t seen any hard data on how much they do use distillation like techniques. They for sure used a bunch of synthetic generated data to get better at reasoning, something that is now commonplace.

Re:Nvidia buying AI chip startup Groq for about $20B by MobiusHorizons on Thursday December 25, 2025 @03:00AM (#46382929)
Thanks it seems I conflated.