News for hackers. Stuff that matters.

A comment on From the creator of Redis; run LLM locally with ds4. Parent comment

Re:From the creator of Redis; run LLM locally with ds4 by madduci on Sunday October 04, 2026 @02:17AM (#49951165)
It worked, the change I had to do was also minimal for the compilation of the .cu unit. You can compile it for the whole iGPU family, not only a specific model.

I've submitted it as PR, as well as an initial implementation for an OpenAI like API

[ Parent | on HN ]

There are no comments on this comment yet.