News for hackers. Stuff that matters.
Re:Interesting Interview with DeepSeek's CEO by int_19h on Tuesday December 31, 2024 @05:36PM (#42562368)
It should be noted that DeepSeek routinely claims to be a "language model trained by OpenAI", so it's pretty clear that it wasn't trained at 10x less cost from scratch, but rather on synthetic output generated by ChatGPT.

Not to point a finger at DeepSeek specifically; this is generally the case for best open source models right now. The best LLaMA finetunes tend to also use ChatGPT-generated synthetic datasets a lot.

Either way, it's unclear what the real cost is when you factor that in.

Re:Interesting Interview with DeepSeek's CEO by Eisenstein on Tuesday December 31, 2024 @11:55PM (#42564057)
If that was the case why are they 10x cheaper than the competition? If everyone is doing it there would be no gains over competitors.