News for hackers. Stuff that matters.

A comment on How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server. Parent comment

Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by manmal on Saturday February 01, 2025 @11:50AM (#42899742)
The Q8 model will likely slow this down to 50%, probably not a very useful speed. The 6k setup will probably do 10-12t/s at Q4.
[ Parent | on HN ]

There are no comments on this comment yet.