News for hackers. Stuff that matters.

A comment on OpenAI Furious DeepSeek Might Have Stolen All the Data OpenAI Stole from Us. Parent comment

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by actuallyalys on Wednesday January 29, 2025 @10:56AM (#42866537)
There’s some truth in that, but isn’t making a radically cheaper version also a new idea that deepseek didn’t know whether it would work? I mean, there was already research into distillation, but there was already research into some of (most of?) OpenAI’s ideas.
[ Parent | on HN ]
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by janalsncm on Thursday January 30, 2025 @06:26AM (#42876827)
Yes, for people who look into the research Deepseek released, there are a good number of novelties which enabled much cheaper R&D. For example, improvements to Mixture of Experts modules and Multi-head Latent Attention. If you have infinite money, you don’t need to innovate there, but DeepSeek didn’t.
[ Parent | on HN ]