Re:Interesting Interview with DeepSeek's CEO
by Eisenstein on Tuesday December 31, 2024 @11:55PM
(#42564057)
If that was the case why are they 10x cheaper than the competition? If everyone is doing it there would be no gains over competitors.
Not to point a finger at DeepSeek specifically; this is generally the case for best open source models right now. The best LLaMA finetunes tend to also use ChatGPT-generated synthetic datasets a lot.
Either way, it's unclear what the real cost is when you factor that in.