News for hackers. Stuff that matters.

A comment on New exponent functions that make SiLU and SoftMax 2x faster, at full accuracy. Parent comment

Re:New exponent functions that make SiLU and SoftMax 2x fast... by GuuD on Wednesday May 15, 2024 @06:59PM (#40373389)
The difference is negligible on 2x 4090. There are more important differences like 4 bit KV cache.
[ Parent | on HN ]

There are no comments on this comment yet.