DeepSeek-v3.1 Release

Re:DeepSeek-v3.1 Release by oktoberpaard on Thursday August 21, 2025 @05:07PM (#44978104)

I’m running Ollama on 2 eGPUs over Thunderbolt. Works well for me. You’re still dealing with an NVDIA device, of course. The connection type is not going to change that hassle.

[ Parent | on HN ]

Re:DeepSeek-v3.1 Release by pdimitar on Thursday August 21, 2025 @05:10PM (#44978144)

Thank you for the validation. As much as I don't like NVIDIA's shenanigans on Linux, having a local LLM is very tempting and I might put my ideological problems to rest over it.

Though I have to ask: why two eGPUs? Is the LLM software smart enough to be able to use any combination of GPUs you point it at?

[ Parent | on HN ]

Re:DeepSeek-v3.1 Release by arcanemachiner on Thursday August 21, 2025 @06:21PM (#44978798)

Yes, Ollama is very plug-and-play when it comes to multi GPU.

llama.cpp probably is too, but I haven't tried it with a bigger model yet.

[ Parent | on HN ]

Re:DeepSeek-v3.1 Release by SV_BubbleTime on Thursday August 21, 2025 @11:31PM (#44980758)

Even today some progress was released on parallelizing WAN video generation over multiple GPUs. LLMs are way easier to split up.

[ Parent | on HN ]