News for hackers. Stuff that matters.
Re:SoftBank sells its entire stake in Nvidia for $5.83B by jasonwatkinspdx on Tuesday November 11, 2025 @05:49PM (#45893974)
No, GPUs are not a particularly ideal architecture for AI inference, it's just inference needs way more memory bandwidth than a general purpose CPU's memory hierarchy can handle.

> What does an ASIC for matmul look like?

A systolic array, and ultimately quite different than a GPU. This is why TPUs et all are a thing.

In general with a systolic array you get a quadratic speedup. For example with a 256x256 array, it takes 256 cycles to shift operations in and out, but in doing that you accomplish 65k MACs in 512 cycles for a speedup of 128x over serial.

Re:SoftBank sells its entire stake in Nvidia for $5.83B by adastra22 on Tuesday November 11, 2025 @07:25PM (#45894808)
The tensor cores in your NVIDIA chip are systolic arrays.
Re:SoftBank sells its entire stake in Nvidia for $5.83B by jasonwatkinspdx on Tuesday November 11, 2025 @10:32PM (#45896119)
Not in the same way as a TPU, and again, the ISA and overall threading architecture matter.