News for hackers. Stuff that matters.
Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by bigyabai on Monday December 01, 2025 @01:31PM (#46111084)
People with basement rigs generally aren't the target audience for these gigantic models. You'd get much better results out of an MoE model like Qwen3's A3B/A22B weights, if you're running a homelab setup.
Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by Spivak on Monday December 01, 2025 @01:35PM (#46111130)
Yeah I think the advantage of OSS models is that you can get your pick of providers and aren't locked into just Anthropic or just OpenAI.
Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by hnfong on Monday December 01, 2025 @06:06PM (#46114740)
Reproducibility of results are also important in some cases.

There are consumer-ish hardware that can run large models like DeepSeek 3.x slowly. If you're using LLMs for a specific purpose that is well-served by a particular model, you don't want to risk AI companies deprecating it in a couple months and push you to a newer model (that may or may not work better in your situation).

And even if the AI service providers nominally use the same model, you might have cases where reproducibility requires you use the same inference software or even hardware to maintain high reproducibility of the results.

If you're just using OpenAI or Anthropic you just don't get that level of control.

Re:DeepSeek-v3.2: Pushing the Frontier of Open Large Languag... by Aachen on Tuesday December 02, 2025 @05:00AM (#46119562)
Who is the target audience of these free releases? I don't mind free and open information sharing but I have wondered what's in it for the people that spent unholy amounts of energy on scraping, developing, and training