Why DeepSeek is cheap at scale but expensive to run locally

Re:Why DeepSeek is cheap at scale but expensive to run locally by ryao on Monday June 02, 2025 @03:45AM (#44156536)

I consider it to be a driver, or at least part of one. Userspace drivers exist. Graphic drivers originally were entirely in userspace, until portions of them were moved into the kernel for kernel mode setting and DRM. These days, graphics drivers themselves have both kernel mode and user mode components. The shader compiler for example would be a user mode component.

[ Parent | on HN ]

Re:Why DeepSeek is cheap at scale but expensive to run locally by DiabloD3 on Tuesday June 03, 2025 @05:34AM (#44168081)

I'm aware. One of the biggest things in fixing the Linux desktop was no longer needing drivers in the Xserver and needing it to be suid root.

What was linked is written in Python. Nothing in Python is ever going to be a userland driver.

[ Parent | on HN ]

Re:Why DeepSeek is cheap at scale but expensive to run locally by ryao on Sunday June 08, 2025 @05:39AM (#44215840)

There is no reason people cannot write userland drivers in Python.

[ Parent | on HN ]