News for hackers. Stuff that matters.
Re:Bolt: Faster matrix and vector operations that run on com... by ffast-math on Sunday June 19, 2022 @01:15AM (#31796340)
IMO it would be super cool and I hope someone does it. There are a lot of interesting tradeoffs around which techniques to use for which matrix sizes and under which assumptions about read vs write ratios, what you have a training set for, whether you can fuse compression intro previous ops, etc.
Re:Bolt: Faster matrix and vector operations that run on com... by a-dub on Sunday June 19, 2022 @11:44AM (#31800382)
hm... so maybe a better place would be one of these toolkits like jax where the entire computation is known at optimization time where a blas would potentially have to do some heroic heuristics to try and fully optimize underneath the blas interface.