News for hackers. Stuff that matters.

A comment on Show HN: Flash Attention in ~100 lines of CUDA. Parent comment

Re:Show HN: Flash Attention in ~100 lines of CUDA by fpgamlirfanboy on Saturday March 16, 2024 @02:02PM (#39728029)
> allows a level of abstraction that doesn't affect performance even a little bit

The second part of this sentence is true because the first part is false.

[ Parent | on HN ]
Re:Show HN: Flash Attention in ~100 lines of CUDA by treesciencebot on Saturday March 16, 2024 @02:17PM (#39728155)
zero cost abstractions exist. doesn't mean all abstractions are zero-cost. or being zero-cost somehow invalidates their abstractness/genericness. but maybe we differ on the definition of abstractions.
[ Parent | on HN ]