Re:DeepSeek: X2 Speed for WASM with SIMD
by htrp on Tuesday January 28, 2025 @02:03PM
(#42856488)
Run your deepseek R1 model on your own hardware.
[ Parent
| on HN ]
Only various distillations are available for most people’s hardware, and they’re quite obviously not as good as actual R1 in my testing.
"$6,000 computer to run Deepseek R1 670B Q8 locally at 6-8 tokens/sec"
https://reddit.com/r/LocalLLaMA/comments/1ic8cjf/6000_comput...