News for hackers. Stuff that matters.
Re:Optimal Performance Without Static Graphs by Fusing Tenso... by nathanielsimard on Tuesday March 19, 2024 @06:47PM (#39761106)
Happy to share what we have been working on lately. The blog post explores Burn's tensor operation stream strategy, optimizing models through an eager API by creating custom kernels with fused operations. Our custom GELU experiment reveal a remarkable improvement of up to 78 times on our WGPU backend.