Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by gatienboquet on Saturday February 01, 2025 @03:10PM
(#42901748)
According to NVIDIA.
> a single server with eight H200 GPUs connected using NVLink and NVLink Switch can run the full, 671-billion-parameter DeepSeek-R1 model at up to 3,872 tokens per second.
You can rent a single H200 for 3$/hour.