News for hackers. Stuff that matters.

A comment on DeepSeek-v3.1 Release. Parent comment

Re:DeepSeek-v3.1 Release by pdimitar on Thursday August 21, 2025 @05:10PM (#44978144)
Thank you for the validation. As much as I don't like NVIDIA's shenanigans on Linux, having a local LLM is very tempting and I might put my ideological problems to rest over it.

Though I have to ask: why two eGPUs? Is the LLM software smart enough to be able to use any combination of GPUs you point it at?

[ Parent | on HN ]
Re:DeepSeek-v3.1 Release by arcanemachiner on Thursday August 21, 2025 @06:21PM (#44978798)
Yes, Ollama is very plug-and-play when it comes to multi GPU.

llama.cpp probably is too, but I haven't tried it with a bigger model yet.

[ Parent | on HN ]
Re:DeepSeek-v3.1 Release by SV_BubbleTime on Thursday August 21, 2025 @11:31PM (#44980758)
Even today some progress was released on parallelizing WAN video generation over multiple GPUs. LLMs are way easier to split up.
[ Parent | on HN ]