News for hackers. Stuff that matters.
Re:Nvidia DGX Spark encrypted firmware slows inference speed... by barrkel on Thursday November 05, 2026 @08:47AM (#50379014)
I'm pretty certain I can get it to go faster by caching experts and whatnot (with experimental llama.cpp branches), but that would consume a lot more VRAM and it's fast enough as it is for playing around with, and I can leave it always loaded. It's like 50% CPU inference, with a few layers + router + kv cache on the GPU.
Re:Nvidia DGX Spark encrypted firmware slows inference speed... by jacquesm on Thursday November 05, 2026 @05:37PM (#50385500)
Unused VRAM is a crime now, I heard ;)