News for hackers. Stuff that matters.

A comment on How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server. Parent comment

Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by Cane_P on Sunday February 02, 2025 @08:28AM (#42908509)
You can connect two, and get 256 GB. But it will still not be enough to run it in native format. You will still need to use lower quant.
[ Parent | on HN ]

There are no comments on this comment yet.