Re:New and Improved Embedding Model for OpenAI
by knome on Thursday December 15, 2022 @10:03PM
(#34009330)
I have been playing with their completions API. I just keep track of previous conversational lines, and when I approach a configurable token threshold ( input+output must fit within the given number of tokens, and it returns it each time ), I just instruct chatgpt to summarize the conversation thus far with additional specific instructions to help it keep useful bits of context. I then make that summary part of the context I send in along with kept and future conversational lines.
Their API calls on the site have references to previous message ids, which makes me expect they're doing something similar.
Their API calls on the site have references to previous message ids, which makes me expect they're doing something similar.