News for hackers. Stuff that matters.

A comment on How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server. Parent comment

Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by TacticalCoder on Saturday February 01, 2025 @09:32AM (#42898574)
TFA says it can bump the spec to 768 GB but that it's then more like $2500 than $2000. At 768 GB that'd be the full, 8 bit, model.

Seems indeed like a good price compared to $6000 for someone who wants to hack a build.

I mean: $6 K is doable but I take it take many who'd want to build such a machine for fun would prefer to only fork $2.5K.

[ Parent | on HN ]
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by manmal on Saturday February 01, 2025 @11:50AM (#42899742)
The Q8 model will likely slow this down to 50%, probably not a very useful speed. The 6k setup will probably do 10-12t/s at Q4.
[ Parent | on HN ]