News for hackers. Stuff that matters.
Re:Interesting Interview with DeepSeek's CEO by mike_hearn on Tuesday December 31, 2024 @07:12AM (#42558266)
You have to distinguish between the current model and DeepSeek the company. DeepSeek the company can do an OpenAI and stop releasing their weights any time they like. The knowledge and skill is retained.

I really wonder how long the current era of giving models away for free can last. How is this sensible from a business perspective? Facebook got burned by iOS and now engage in what would otherwise look like irrational behavior to avoid being locked into a supplier again, but even then, they don't really need to give Llama away for free. They could train and use it for themselves just fine.

Re:Interesting Interview with DeepSeek's CEO by nprateem on Tuesday December 31, 2024 @10:21AM (#42559194)
You don't think FB are trying to neuter an emerging threat? They're kneecapping what could have been a trillion dollar company if it was more difficult to replicate their tech.
Re:Interesting Interview with DeepSeek's CEO by coliveira on Tuesday December 31, 2024 @04:18PM (#42561894)
If they're smart, and of course they are, they're not releasing the latest they have. They're releasing something enough to show everyone that they're at parity or better compared to OpenAI. I imagine they already have internal models that exceed the open source one, so there's no real advantage in copying what they released.
Re:Interesting Interview with DeepSeek's CEO by cma on Tuesday December 31, 2024 @07:05PM (#42562841)
They would have to pay more to get researchers that don't publish.
Re:Interesting Interview with DeepSeek's CEO by mike_hearn on Wednesday January 01, 2025 @08:43AM (#42565963)
I was talking about open weight models more than papers, but OpenAI hardly publishes papers anymore and don't seem to struggle to get researchers. Anthropic are clearly doing a lot of special sauce given Claude 3.5 Sonnet's performance on coding, yet the papers they publish are mostly safety related. So I'm not sure that's really true anymore.
Re:Interesting Interview with DeepSeek's CEO by mistercheph on Wednesday January 01, 2025 @02:54PM (#42568744)
Open models will win, OpenAI and the other regulatory capture gamers that want to hoard their precious will certainly be an interesting footnote for the history books.