Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op...
by ambicapter on Wednesday January 29, 2025 @11:52AM
(#42867522)
Only weird if you think what OpenAI did should be the norm.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op...
by wrasee on Wednesday January 29, 2025 @12:23PM
(#42868042)
Right. I think many here are enjoying the Schadenfreude against OpenAI, but that hardly makes it right. It just makes it a race to the bottom.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op...
by wrasee on Wednesday January 29, 2025 @12:41PM
(#42868343)
It is a remarkable achievement. But if “some training data from OpenAI” turns out to essentially be a wholesale distillation of their entire model (along with Llama etc) I do think that somewhat dampens the spirit of it.
We don’t know that of course. OpenAI claim to have some evidence and I guess we’ll just have to wait and see how this plays out.
There’s also a substantial difference between training of the entire internet and one that very specifically targets your competitor's products (or any specific work directly).
Edit: Responding to your edit, Deepseek only claimed that the final training run was $5m, not that the whole process caught that (they even call this out). I think it's important to acknowledge that, even if they did get some training data from OpenAI, this is a remarkable achievement.