Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi...
by zozbot234 on Thursday January 08, 2026 @05:20PM
(#46547304)
You don't need much on-device RAM for compute-bound tasks, though. You just shuffle the data in and out, trading a bit of latency for an overall gain on power efficiency which will help whenever your computation is ultimately limited by power and/or thermals.
Obviously in the future this might change. But as we stand now dedicated silicon for _just_ LLM prefill doesn't make a lot of sense imo.