You can run into issues with long running threads. It only has so much context (I think around 4K words). It doesn’t have all the context of all the thread. My understanding is that it is summarizing the thread and resubmitting it as part of the prompt each time.

It took me a while to figure out why it kept forgetting things from earlier in the thread.

I’m looking forward to when you can have a bigger context or explicitly set some sort of context that is persistent.

32k words with GPT-4, no? That's what they said in the demo video.

only with api and only if you're invited to one.

32k _tokens_. There are approx. 3/4 tokens per word, so that's around 24k words

Oh, that's interesting. I hadn't noticed it forgetting context, but I just asked "Do you remember the original prompt I gave you when starting this conversation?" and it said "Yes, the original prompt you gave me was: 'Hello, can you help me convert 0.05 BTC to USD?'". So, yeah, it's definitely forgetting some things.

> think around 4K words

4k _tokens_, 1 token is approx. 3/4 a word. So it's roughly 3k words

Yep, the threads are permanent. I've got approximately 200 separate threads going with it right now.

I gave it a summary when I started using it: "I am building an app using Expo, React Native, React Navigation, React Query, Nativebase, Google Maps and lodash. Expo exports the app for web, iOS and Android. The purpose of the app is to view data related to <specific domain> on a map. The data comes from an internal API."

Then I started copying and pasting code or asking questions about using the libraries I had mentioned.

Wow thats incredible. How are you managing the 200 threads - are you using the api for that? Or just using their chat interface on chat.openai.com and scrolling to the relevant one to continue the converstaion