News for hackers. Stuff that matters.

A comment on Why DeepSeek is cheap at scale but expensive to run locally. Parent comment

Re:Why DeepSeek is cheap at scale but expensive to run locally by DiabloD3 on Monday June 02, 2025 @02:20AM (#44156207)
They were doing this before, the difference with this is, the version of ROCm you use is locked to the driver versions that are supported, which is a very narrow range.

With this new thing, the backend API is now formalized and easier to support wider range of difference.

[ Parent | on HN ]

There are no comments on this comment yet.