Re:MemGPT – LLMs with self-editing memory for unbounded context
by littlestymaar on Monday October 16, 2023 @01:50PM
(#37903524)
Same here, it looks like the idea was pretty obvious. Glad to see it implemented though.
Context length being so limited is the number one thing that rules LLM as possessing something that resemble “intelligence”, so if we this kind of unbounded context length we're entering into a completely new universe in terms of LLM abilities.
Re:MemGPT – LLMs with self-editing memory for unbounded context
by shishirpatil on Monday October 16, 2023 @02:36PM
(#37904129)
Thanks @wilg and @littlestymaar ! Yeah totally, with the benefit of hindsight, this makes total sense! Hope you find some of our codebase useful to build on top of. We are an Apache 2.0 licensed open source project and welcome contributions :)
Re:MemGPT – LLMs with self-editing memory for unbounded context
by pacjam on Monday October 16, 2023 @03:38PM
(#37905195)
If you have a chance try it out via the Discord bot or with the GitHub repo! Or even just check out the short demo GIFs we released (at https://github.com/cpacker/memgpt) to get an idea of the MemGPT inputs/outputs.
The high-level memory read/writes are quite intuitive and you may be surprised at how close it matches what you were suggesting to your friend.
However, I do think the context length is one of the top improvements that would make LLMs much more useful.