Re:Ask HN: How do you scale transformer context lengths over...
by mlstudies on Friday November 24, 2023 @02:53AM
(#38401557)
I'm a few months off on the latest, but one way used to be to start summarizing history if the context did start becoming huge: summarize the earliest n-k messages, keep the last k.
[ Parent
| on HN ]
There are no comments on this comment yet.