News for hackers. Stuff that matters.

A comment on Attention with Linear Biases (ALiBi). Parent comment

Re:Attention with Linear Biases (ALiBi) by ipsum2 on Tuesday May 16, 2023 @02:59AM (#35958525)
xpos is SoTA right now: https://arxiv.org/pdf/2212.10554.pdf
[ Parent | on HN ]
Re:Attention with Linear Biases (ALiBi) by Eridrus on Wednesday May 17, 2023 @07:02AM (#35973638)
Thanks!
[ Parent | on HN ]