Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server
by bick_nyers on Saturday February 01, 2025 @11:09AM
(#42899424)
It will be slower for a 70b model since Deepseek is an MoE that only activates 37b at a time. That's what makes CPU inference remotely feasible here.
[ Parent
| on HN ]
There are no comments on this comment yet.