Re:Bolt: Faster matrix and vector operations that run on com...
by skohan on Saturday June 18, 2022 @03:46PM
(#31793123)
It already is right? A GPU is basically a purpose-built linear algebra machine.
[ Parent
| on HN ]
Re:Bolt: Faster matrix and vector operations that run on com...
by mandarax8 on Saturday June 18, 2022 @04:02PM
(#31793303)
From the abstract:
> (In the common case that one matrix is known ahead of time,) our method also has the in- teresting property that it requires zero multiply-adds. These results suggest that a mixture of hashing, aver- aging, and byte shuffling—–the core operations of our method—–could be a more promising building block for machine learning than the sparsified, factorized, and/or scalar quantized matrix products that have re- cently been the focus of substantial research and hard- ware investment.`
This is not at all what modern gpus are optimized for.