News for hackers. Stuff that matters.

A comment on Why DeepSeek is cheap at scale but expensive to run locally. Parent comment

Re:Why DeepSeek is cheap at scale but expensive to run locally by latchkey on Monday June 02, 2025 @02:08AM (#44156171)
https://community.amd.com/t5/ai/what-s-new-in-amd-rocm-6-4-b...

ROCm 6.4 software introduces the Instinct GPU Driver, a modular driver architecture that separates the kernel driver from ROCm user space.

[ Parent | on HN ]
Re:Why DeepSeek is cheap at scale but expensive to run locally by DiabloD3 on Monday June 02, 2025 @02:20AM (#44156207)
They were doing this before, the difference with this is, the version of ROCm you use is locked to the driver versions that are supported, which is a very narrow range.

With this new thing, the backend API is now formalized and easier to support wider range of difference.

[ Parent | on HN ]