News for hackers. Stuff that matters.
Re:Nvidia Was in Trouble Before the Jensen Huang Mess by epistasis on Monday November 16, 2026 @12:48PM (#50520464)
Inference has two steps, prefill and decode, with very different requirements on the compute to memory-bandwidth ratio.

Already these are run on different hardware, at least as I understand, and the computational needs could further drive differentiation.

There are no comments on this comment yet.