Re:OpenAI ChatGPT: Optimizing Language Models for Dialogue
by nl on Wednesday November 30, 2022 @07:31PM
(#33810420)
> Relevant past memories:
> <splice in the N past messages with the most similar embedding to the most recent messages>
This is a really good idea. Presumably you'd keep the memory per-person.
Yes you would still need GPT3 in this system. Right now, the incredibly simple system just wires gives GPT3 a window of the last 100 messages and has it output the next message to send.
Then you can have GPT3 output what it believes the most likely next message is, and you send it. But this system means it loses context if a message is outside the window. So you can augment this system by creating an embedding of the last few messages of the conversation, and creating a prompt like: So this gets you a kind of short term memory (the last 100 messages) and a long term memory (the embeddings).