Running the Deepseek-R1 671B Model at FP16 Fidelity on AMD EPYC CPUs

Posted by tanelpoder on Friday April 04, 2025 @10:52AM
from the servethehome.com dept.

( 2 comments | 3 points | on HN )

Re:Running the Deepseek-R1 671B Model at FP16 Fidelity on AM... by sgt on Friday April 04, 2025 @10:58AM (#43583405)

Mac Mini with Ultra might be 10-20x faster in terms of tokens/sec on the same model.

[ Parent | on HN ]

Re:Running the Deepseek-R1 671B Model at FP16 Fidelity on AM... by sleepingreset on Friday April 04, 2025 @10:54AM (#43583337)

nice

[ Parent | on HN ]