Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation. Parent comment
> these models dominate both exponential attention and linear attention at long-context training
There is no exponential attention; standard attention is quadratic. Strange mistake.
There are no comments on this comment yet.
> these models dominate both exponential attention and linear attention at long-context training
There is no exponential attention; standard attention is quadratic. Strange mistake.