News for hackers. Stuff that matters.
Re:Ask HN: How do you scale transformer context lengths over... by mlstudies on Friday November 24, 2023 @02:53AM (#38401557)
I'm a few months off on the latest, but one way used to be to start summarizing history if the context did start becoming huge: summarize the earliest n-k messages, keep the last k.

There are no comments on this comment yet.