News for hackers. Stuff that matters.
Re:Nvidia DGX Spark encrypted firmware slows inference speed... by impossiblefork on Wednesday November 04, 2026 @05:54AM (#50363796)
Yeah, that was why I felt that, while Taalas might not be the right thing in general, it could be really appealing in a laptop, that would otherwise not be able to run any big model at all.

I think I misunderstood what the technology could do a little bit, because I imagined these fixed matrix multiplies encoded into hardware as small-ish, as using routing space etc., not just fast.

I think what I really imagined was useful would be more easily achieved by having a big ROM with model weights connected to an ordinary GPU.

There are no comments on this comment yet.