News for hackers. Stuff that matters.
Re:The GPU is not always faster by alecco on Wednesday December 11, 2024 @02:39PM (#42391891)
And both 3090 and 4090 can do 32 GB/s host-device. Not far from CPU-RAM. You only load the matrix once. The bandwidth for the matmul is orders of magnitude larger and happens all in device and mostly in cache.

There are no comments on this comment yet.