News for hackers. Stuff that matters.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by jenny91 on Saturday February 01, 2025 @08:58AM (#42898313)
As a data point: you can get an RTX 3090 for ~$1.2k and it runs deepseek-r1:32b perfectly fine via Ollama + open webui at ~35 tok/s in an OpenAI-like web app and basically as fast as 4o.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by kevinak on Saturday February 01, 2025 @09:12AM (#42898406)
You mean Qwen 32b fine-tuned on Deepseek :)

There is only one model of Deepseek (671b), all others are fine-tunes of other models

Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by driverdan on Saturday February 01, 2025 @09:18AM (#42898450)
> you can get an RTX 3090 for ~$1.2k

If you're paying that much you're being ripped off. They're $800-900 on eBay and IMO are still overpriced.