News for hackers. Stuff that matters.
Re:MemGPT – LLMs with self-editing memory for unbounded context by wilg on Monday October 16, 2023 @01:27PM (#37903217)
I was just suggesting something like this to a friend yesterday! (Neither of us know enough to do it or know if it's a good idea.)

However, I do think the context length is one of the top improvements that would make LLMs much more useful.

Re:MemGPT – LLMs with self-editing memory for unbounded context by littlestymaar on Monday October 16, 2023 @01:50PM (#37903524)
Same here, it looks like the idea was pretty obvious. Glad to see it implemented though.

Context length being so limited is the number one thing that rules LLM as possessing something that resemble “intelligence”, so if we this kind of unbounded context length we're entering into a completely new universe in terms of LLM abilities.

Re:MemGPT – LLMs with self-editing memory for unbounded context by shishirpatil on Monday October 16, 2023 @02:36PM (#37904129)
Thanks @wilg and @littlestymaar ! Yeah totally, with the benefit of hindsight, this makes total sense! Hope you find some of our codebase useful to build on top of. We are an Apache 2.0 licensed open source project and welcome contributions :)
Re:MemGPT – LLMs with self-editing memory for unbounded context by pacjam on Monday October 16, 2023 @03:38PM (#37905195)
If you have a chance try it out via the Discord bot or with the GitHub repo! Or even just check out the short demo GIFs we released (at https://github.com/cpacker/memgpt) to get an idea of the MemGPT inputs/outputs.

The high-level memory read/writes are quite intuitive and you may be surprised at how close it matches what you were suggesting to your friend.