News for hackers. Stuff that matters.
Re:SubQ: a sub-quadratic LLM with 12M-token context by williamimoh on Tuesday May 05, 2026 @11:14AM (#48023665)
Looks like long context isn’t a problem anymore
Re:SubQ: a sub-quadratic LLM with 12M-token context by tamarru on Tuesday May 05, 2026 @11:22AM (#48023791)
Neither is cost, and latency, in the long-term. LLMs ultimately become more economically viable than they are now, and broaden the scope of every existing LLM-driven application (particularly STS, conversational AI, etc, etc.)