Re:MemGPT – LLMs with self-editing memory for unbounded context
by ASalazarMX on Monday October 16, 2023 @02:56PM
(#37904457)
Would this be the same method used to assign a title to your chat based on the first prompt? It's surprisingly effective at getting the core idea most of the time.
[ Parent
| on HN ]
Re:MemGPT – LLMs with self-editing memory for unbounded context
by pacjam on Monday October 16, 2023 @03:09PM
(#37904680)
Thanks for your interest! Question - does the title of the chat ever change after it's first assigned? If so, using a recursive summary to refresh the title sounds like a reasonable idea (especially if you're already computing a summary to extend context).
From what I remember the title in ChatGPT gets set once after a few messages, in which case I'd assume it's generated with a special "title generation" prompt (that gets the first few messages as input).
In either case since I don't work at OpenAI I can't tell you for sure ;)