News for hackers. Stuff that matters.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by gatienboquet on Saturday February 01, 2025 @03:10PM (#42901748)
According to NVIDIA. > a single server with eight H200 GPUs connected using NVLink and NVLink Switch can run the full, 671-billion-parameter DeepSeek-R1 model at up to 3,872 tokens per second.

You can rent a single H200 for 3$/hour.

There are no comments on this comment yet.