News for hackers. Stuff that matters.
Re:How to Run DeepSeek R1 671B Locally on a $2000 EPYC Server by geertj on Saturday February 01, 2025 @08:20AM (#42898084)
> I’d be curious if this would just be a linear slowdown proportional to the RAM MHz or whether CAS latency plays into it as well.

Per o3-mini, the blocked gemm (matrix multiply) operations have very good locality and therefore MT/s should matter much more than CAS latency.

There are no comments on this comment yet.