Re:AI CapEx Is Eating the Economy
by pdhborges on Friday July 18, 2025 @05:14PM
(#44609898)
Where is that improvement coming from? Hardware is already here to compute gemm as fast as possible.
[ Parent
| on HN ]
Re:AI CapEx Is Eating the Economy
by leakyfilter on Friday July 18, 2025 @05:17PM
(#44609936)
Raw gemm computation was never the real bottleneck, especially on the newer GPUs. Feeding the matmuls i.e memory bandwidth is where it’s at, especially in the newer GPUs.