News for hackers. Stuff that matters.
Re:Hacking Around ChatGPT’s Character Limits with the Code I... by jph00 on Sunday May 28, 2023 @01:47AM (#36101511)
FlashAttention has memory linear in sequence length. https://github.com/HazyResearch/flash-attention

There are no comments on this comment yet.