News for hackers. Stuff that matters.

A comment on DeepSeek R1 analysis: open-source model has propaganda re: "motherland" baked in. Parent comment

Re:DeepSeek R1 analysis: open-source model has propaganda re... by sylware on Tuesday February 04, 2025 @06:38AM (#42931100)
Nope, you can run the 671B on 100% CPU and storage. It is going to be longer to get tokens out of it, but it will work.

Heard there are some optimizations for CPU inference on storage, then it should be somewhat a tad "less slow".

Time to split that RAM among your CPU cores and mmap blocks of weights for inference from storage.

[ Parent | on HN ]
Re:DeepSeek R1 analysis: open-source model has propaganda re... by Anaphylaxis on Wednesday February 05, 2025 @08:08AM (#42947958)
Sure but he explicitly stated, 'GPU Servers', making it likely he didn't use the CPU for inferencing, validating the question about what GPU setup did they use
[ Parent | on HN ]