News for hackers. Stuff that matters.
Re:Tensor Product Attention Is All You Need by apophis-ren on Sunday February 02, 2025 @10:45PM (#42914705)
Flash attention is an implementation trick; you can implement MHA/GQA, for example, with flash attention.

There are no comments on this comment yet.