News for hackers. Stuff that matters.
Re:New and Improved Embedding Model for OpenAI by knome on Thursday December 15, 2022 @10:03PM (#34009330)
I have been playing with their completions API. I just keep track of previous conversational lines, and when I approach a configurable token threshold ( input+output must fit within the given number of tokens, and it returns it each time ), I just instruct chatgpt to summarize the conversation thus far with additional specific instructions to help it keep useful bits of context. I then make that summary part of the context I send in along with kept and future conversational lines.

Their API calls on the site have references to previous message ids, which makes me expect they're doing something similar.

There are no comments on this comment yet.