Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi...
by adgjlsfhk1 on Thursday January 08, 2026 @10:05PM
(#46549633)
I've yet to see any convincing benchmarks showing that NPUs are more efficient than normal GPUs (that don't ignore the possibility of downclocking the GPU to make it run slower but more efficient)
[ Parent
| on HN ]
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi...
by adastra22 on Thursday January 08, 2026 @10:11PM
(#46549664)
NPUs are more energy efficient. There is no doubt that a systolic array uses less watts per computation than a tensor operation on a GPU, for these kinds of natural fit applications.
Are they more performant? Hell no. But if you're going to do the calculation, and if you don't care about latency or throughput (e.g. batched processing of vector encodings), why not use the NPU?
Especially on mobile/edge consumer devices -- laptops or phones.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi...
by hulitu on Sunday January 11, 2026 @01:50PM
(#46578502)
> NPUs are more energy efficient. There is no doubt
Maybe because they sleep all the time. To be able to use an NPU you need at least a compiler which generates code for this particular NPU and a CPU scheduler which can dispatch instructions to this NPU.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi...
by imtringued on Friday January 09, 2026 @06:06AM
(#46552565)