Re:Running DeepSeek R1 Models Locally on NPU
by rahimnathwani on Monday February 03, 2025 @01:19AM
(#42915490)
Deepseek R1 has 671 billion parameters. Even if you could quantize each parameter to just 1 bit (from 8 bits), you'd still need 84GB of RAM just for the weights. There is no 32B parameter version of the V3/R1 model architecture.
[ Parent
| on HN ]
There are no comments on this comment yet.