Re:Bolt: Faster matrix and vector operations that run on com...
by ffast-math on Sunday June 19, 2022 @01:15AM
(#31796340)
IMO it would be super cool and I hope someone does it. There are a lot of interesting tradeoffs around which techniques to use for which matrix sizes and under which assumptions about read vs write ratios, what you have a training set for, whether you can fuse compression intro previous ops, etc.
[ Parent
| on HN ]
Re:Bolt: Faster matrix and vector operations that run on com...
by a-dub on Sunday June 19, 2022 @11:44AM
(#31800382)
hm... so maybe a better place would be one of these toolkits like jax where the entire computation is known at optimization time where a blas would potentially have to do some heroic heuristics to try and fully optimize underneath the blas interface.