News for hackers. Stuff that matters.
Re:Show HN: Flash Attention in ~100 lines of CUDA by cavisne on Saturday March 16, 2024 @07:02PM (#39730231)
Probably https://www.youtube.com/watch?v=nOxKexn3iBo (or just skimming the attached colab).
Re:Show HN: Flash Attention in ~100 lines of CUDA by xrd on Saturday March 16, 2024 @07:38PM (#39730435)
This is terrific, thanks!