Re:Running DeepSeek R1 Models Locally on NPU
by tamlin on Tuesday February 04, 2025 @12:05PM
(#42935271)
Yes, agree. Probably the main thing is the NPU is just a dedicated unit without the generality / complexity of a CPU and so able to crunch matmuls more efficiently.
[ Parent
| on HN ]
There are no comments on this comment yet.