News for hackers. Stuff that matters.
Re:Bolt: Faster matrix and vector operations that run on com... by skohan on Saturday June 18, 2022 @03:46PM (#31793123)
It already is right? A GPU is basically a purpose-built linear algebra machine.
Re:Bolt: Faster matrix and vector operations that run on com... by mandarax8 on Saturday June 18, 2022 @04:02PM (#31793303)
From the abstract:

> (In the common case that one matrix is known ahead of time,) our method also has the in- teresting property that it requires zero multiply-adds. These results suggest that a mixture of hashing, aver- aging, and byte shuffling—–the core operations of our method—–could be a more promising building block for machine learning than the sparsified, factorized, and/or scalar quantized matrix products that have re- cently been the focus of substantial research and hard- ware investment.`

This is not at all what modern gpus are optimized for.