News for hackers. Stuff that matters.
Re:Attention at Constant Cost per Token via Symmetry-Aware T... by andes314 on Wednesday February 04, 2026 @10:56AM (#46887391)
Linear time attention doesn’t work, by principle. Dead end pursuit. Much great research on more efficient quadratic time inference
Re:Attention at Constant Cost per Token via Symmetry-Aware T... by smokel on Wednesday February 04, 2026 @11:57AM (#46888271)
What about n log n?