News for hackers. Stuff that matters.
Re:New and Improved Embedding Model for OpenAI by tshadley on Thursday December 15, 2022 @07:57PM (#34008078)
https://help.openai.com/en/articles/6787051-does-chatgpt-rem...

> While ChatGPT is able to remember what the user has said earlier in the conversation, there is a limit to how much information it can retain. The model is able to reference up to approximately 3000 words (or 4000 tokens) from the current conversation - any information beyond that is not stored.

This implies ChatGPT has a 4000 token maximum prompt and prior prompts in a given web session are inserted into the current prompt, most recent to oldest (probably with some sort of time context like "previously, user asked:"), up to 4000 tokens.

Re:New and Improved Embedding Model for OpenAI by IanCal on Thursday December 15, 2022 @08:23PM (#34008298)
I've had longer discussions but I'm realising that I often ask for a summary, which would mean the model has a summary of the conversation so far in the window.
Re:New and Improved Embedding Model for OpenAI by melony on Thursday December 15, 2022 @10:09PM (#34009392)
What's the technical limit? The width of the attention layer?