News for hackers. Stuff that matters.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by buildbot on Monday November 16, 2026 @03:26PM (#50522718)
In my personal opinion as well "specialized enough" chips are exactly the right way to go - though disclaimer, also At Nvidia, working on spec dec/external drafts :)

With things like https://developer.nvidia.com/blog/co-designing-ai-models-usi... you can specialize one chip for decode/drafting, and the other for prefill and draft verification.

There are no comments on this comment yet.