News for hackers. Stuff that matters.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by bmicraft on Wednesday January 29, 2025 @05:29PM (#42872102)
Yeah, but that kills the implied hope of building a better model for cheaper. Like this you'll always have a ceiling of being a bit worse then the openai models.
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by reassess_blind on Wednesday January 29, 2025 @06:46PM (#42872903)
Isn't DeepSeek a bit better, not worse?
Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by roenxi on Thursday January 30, 2025 @01:06AM (#42875337)
The logic doesn't exactly hold, it is like saying that a student is limited by their teachers. It is certainly possible that a bad teacher will hold the student back, but ultimately a student can lag or improve on the teacher without only a little extra stimulus.

They probably would need some other source of truth than an existing model, but it isn't clear how much additional data is needed.

Re:OpenAI Furious DeepSeek Might Have Stolen All the Data Op... by diedyesterday on Thursday January 30, 2025 @10:24AM (#42878589)
Don't forget that this model probably has far less params than o1 or even 4o. This is a compression/distillation, which means it frees up so much compute resources to build models much powerful than o1. At least this allows further scaling compute-wise (if not in the amount of, non-synthetic, source material available for training).