News for hackers. Stuff that matters.
Re:OpenAI starts testing ChatGPT premium by shrimpx on Saturday January 14, 2023 @05:14AM (#34378998)
Thank you, that's really insightful! Presumably you could get it to summarize the conversation when the conversation reaches max tokens.
Re:OpenAI starts testing ChatGPT premium by shagie on Saturday January 14, 2023 @11:48AM (#34381640)
Likely yes. You could even switch to a less intensive model for doing that (e.g. Curie). The Curie model is 1/10th as costly as Davinci to run. Running 8k tokens through Davinci is $0.16 while Curie would only be $0.016 - and that's likely showing up in back end compute and should be considered if someone was building their own chat bot on top of gpt3.