News for hackers. Stuff that matters.
Re:Claude: System Prompts by cubefox on Sunday August 16, 2026 @10:35AM (#49320492)
Unless they are using a linear architecture, the compute cost still scales O(n²) for n tokens, and nemory cost scales O(n).
Re:Claude: System Prompts by TZubiri on Sunday August 16, 2026 @12:52PM (#49321644)
>the compute cost still scales O(n²) for n tokens,

That is never the cost, it's a common misconception.

Cost scales linearly per tokens. Unless you are sending one token at a time and avoiding using the same machine or cache.

Just look at api charges, they are charged by token, not by token squared.

Re:Claude: System Prompts by cubefox on Sunday August 16, 2026 @01:36PM (#49321991)
Which seems to contradict the usual consensus that purely linear architectures are not sufficiently capable and unsuited for frontier models.