News for hackers. Stuff that matters.

A comment on Show HN: Flash Attention in ~100 lines of CUDA. Parent comment

Re:Show HN: Flash Attention in ~100 lines of CUDA by danielhanchen on Sunday March 17, 2024 @08:57AM (#39734187)
Oh ok! Ye the backwards passes are always much more difficult due to the derivatives!
[ Parent | on HN ]

There are no comments on this comment yet.