News for hackers. Stuff that matters.

A comment on Running the Deepseek-R1 671B Model at FP16 Fidelity on AMD EPYC CPUs.

Re:Running the Deepseek-R1 671B Model at FP16 Fidelity on AM... by sgt on Friday April 04, 2025 @10:58AM (#43583405)
Mac Mini with Ultra might be 10-20x faster in terms of tokens/sec on the same model.
[ Parent | on HN ]

There are no comments on this comment yet.