Re:Recursively Summarizing Enables Long-Term Dialogue Memory...
by anotherpaulg on Saturday September 02, 2023 @09:09PM
(#37366843)
Aider does this too, using a background thread to summarize the messages older than the last N.
https://github.com/paul-gauthier/aider/blob/main/aider/histo...
Re:Recursively Summarizing Enables Long-Term Dialogue Memory...
by px43 on Saturday September 02, 2023 @10:11PM
(#37367129)
Yeah, I'm pretty novice, but I took that hourish long Andrew Ng class on LangChain, and they covered recursive summarization as a standard memory management technique.
https://www.deeplearning.ai/short-courses/langchain-for-llm-...
Re:Recursively Summarizing Enables Long-Term Dialogue Memory...
by LightHugger on Tuesday September 05, 2023 @09:34AM
(#37391437)
This poster is a nazi. Just thought I'd make sure everyone knows.
Many implementations utilize a fixed sized buffer, progressively summarizing batches of older memories when they fall out of the buffer. Ideally, this is also done out of band to the chat loop.
I’m an author of Zep[0], an open source long-term memory store, and this is how we implemented summarization.
0: https://github.com/getzep/zep