News for hackers. Stuff that matters.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by hacker_homie on Thursday January 08, 2026 @04:16PM (#46546606)
Yeah, that's because the original npus were a rush job, the amd AI Max is the only one that's worth anything in my opinion.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by mrinterweb on Thursday January 08, 2026 @04:26PM (#46546715)
The Apple M series chips are solid for inference.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by hamdingers on Thursday January 08, 2026 @05:52PM (#46547672)
Correct me if I'm wrong, but I thought everyone was still doing inference on the GPU for Apple silicon.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by mrinterweb on Thursday January 08, 2026 @07:51PM (#46548735)
The Apple M series is SoC. The CPU, GPU, NPU, RAM are all part of the chip.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by wtallis on Thursday January 08, 2026 @10:03PM (#46549621)
The RAM is not part of the SoC. It's a bunch of separate commodity RAM dies packaged alongside the SoC.
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by Dylan16807 on Thursday January 08, 2026 @08:21PM (#46548981)
Is that because of the actual processing unit or because they doubled the width of the memory bus?
Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by zamadatix on Thursday January 08, 2026 @08:33PM (#46549061)
It's because it comes with a decent iGPU, not because of the NPU inside of that. The NPU portion is still the standard tiny 50 TOPS and could be filled with normal RAM bandwidth like on a much cheaper machine.

On the RAM bandwidth side it depends if you want to look at it as "glass is half full" or "glass is half empty". For "glass is half full" the GPU has access to a ton of RAM at ~2x-4x the bandwidth of normal system memory an iGPU would have and so you can load really big models. For "glass is half empty" that GPU memory bandwidth is still nearly 2x less than a even a 5060 dGPU (which doesn't have to share any of that bandwidth with the rest of the system), but you won't fit as large of a model on a dGPU and it won't be as power efficient.

Speaking of power efficiency - it is decently power efficient... but I wouldn't run AI on battery on mine unless I was plugged in anyways as it still eats through the battery pretty quick when doing so. Great general workstation laptop for the size and wattage though.

Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by SomeHacker44 on Friday January 09, 2026 @04:25AM (#46551781)
I have a Strix Halo 395 128GB laptop running Ubuntu from HP. I have not been able to do anything with the NPU. I was hoping it could be used for OpenCL, but does not seem so.

What examples do you have of making the NPU in this processor useful please?

Re:Dell's CES 2026 chat was the most pleasingly un-AI briefi... by pseudosavant on Friday January 09, 2026 @12:46PM (#46556617)
All the videos I've seen of AI workloads with an AMD Strix Halo with 128GB setup have used the GPU for the processing. It has a powerful iGPU and unified memory more like Apple's M chips.