Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by ganoushoreilly on Saturday February 01, 2025 @12:05PM
(#42899873)
and people are missing the "Starting at" price. I suspect the advertised specs will end up more than $3k. If it comes out at that price, i'm in for 2. But I'm not holding my breath given Nvidia and all.
[ Parent
| on HN ]
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by Cane_P on Sunday February 02, 2025 @08:14AM
(#42908425)
CPU (20 ARM cores), GPU (1 PFLOP of FP4) and memory (128 GB) seems fixed, so the only configurable parts would be storage (up to 4TB) and cabling (if you want to connect two DIGITS).
We kind of know what storage cost in a store and we know that Apple (Mac computers) and every phone manufacturer adds a ton of cost for a small increase. NVIDIA will probably do the same.
I have no idea what the cost for their cabling would be, but they exist in 100G, 200G, 400G and 800G speeds and you seem to need two of them.