News for hackers. Stuff that matters.

A comment on DeepSeek proves the future of LLMs is open-source. Parent comment

Re:DeepSeek proves the future of LLMs is open-source by cedws on Wednesday January 29, 2025 @11:21AM (#42866935)
Even with the training material what good is it? The model isn’t reproducible, and even if it were you’re not going to spend the money to verify the output.
[ Parent | on HN ]
Re:DeepSeek proves the future of LLMs is open-source by deegles on Wednesday January 29, 2025 @11:24AM (#42867011)
I guess something like a kickstarter campaign would be needed to get together the millions of dollars needed per training run
[ Parent | on HN ]
Re:DeepSeek proves the future of LLMs is open-source by Gigachad on Thursday January 30, 2025 @03:23AM (#42875988)
Who would fund that? What would be the point?
[ Parent | on HN ]
Re:DeepSeek proves the future of LLMs is open-source by mistercheph on Wednesday January 29, 2025 @12:47PM (#42868430)
Frontier models will never be reproducible in the freedom-loving countries that enforce intellectual property law, since they all depend on copyrighted content in their training data.
[ Parent | on HN ]
Re:DeepSeek proves the future of LLMs is open-source by barnabee on Wednesday January 29, 2025 @02:14PM (#42869695)
> The model isn’t reproducible

Not necessarily[0], it's a WIP, but: https://github.com/huggingface/open-r1

[0] Surely they won't end up with the exact same weights, but it should be possible to verify something about the model and approach

[ Parent | on HN ]
Re:DeepSeek proves the future of LLMs is open-source by fragmede on Wednesday January 29, 2025 @02:19PM (#42869774)
why not? if we could get a version of ChatGPT that wasn't censored and would tell me how to make meth, or an censored version of deepseek that wanted to talk about tank man, you don't think the Internet would come together and make that happen?
[ Parent | on HN ]