News for hackers. Stuff that matters.
Re:Running DeepSeek R1 Models Locally on NPU by rahimnathwani on Monday February 03, 2025 @01:19AM (#42915490)
Deepseek R1 has 671 billion parameters. Even if you could quantize each parameter to just 1 bit (from 8 bits), you'd still need 84GB of RAM just for the weights. There is no 32B parameter version of the V3/R1 model architecture.

There are no comments on this comment yet.