News for hackers. Stuff that matters.

A comment on Show HN: Flash Attention in ~100 lines of CUDA. Parent comment

Re:Show HN: Flash Attention in ~100 lines of CUDA by whimsicalism on Saturday March 16, 2024 @10:09PM (#39731325)
block level rather than thread level programming, automatic optimization across hyperparameters, makes it much easier to write fast kernels
[ Parent | on HN ]

There are no comments on this comment yet.