Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by jenny91 on Saturday February 01, 2025 @08:58AM
(#42898313)
As a data point: you can get an RTX 3090 for ~$1.2k and it runs deepseek-r1:32b perfectly fine via Ollama + open webui at ~35 tok/s in an OpenAI-like web app and basically as fast as 4o.
[ Parent
| on HN ]