Re:Nvidia and OpenAI abandon unfinished $100B deal in favour...
by zozbot234 on Friday February 20, 2026 @11:35AM
(#47090242)
Prefill has a lot of parallelism, and so does decode with a larger context (very common with agentic tasks). People like to say "old inference chips are no good for LLM use" but that's not really true.
They've obviously adapted the design but it's a risk optimising in hardware like that - if there is another model architecture jump the risk of having a narrow specialised set of hardware means you can't generalise enough.