News for hackers. Stuff that matters.

A comment on Running DeepSeek R1 Models Locally on NPU. Parent comment

Re:Running DeepSeek R1 Models Locally on NPU by rahimnathwani on Monday February 03, 2025 @01:15AM (#42915468)
That model's weights are around 64GB: https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-...

GP is likely running the 4-bit quantized version of the finetuned Qwen model.

[ Parent | on HN ]

There are no comments on this comment yet.