News for hackers. Stuff that matters.
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by Ultimatt on Sunday March 12, 2023 @01:56AM (#35117512)
Sure but at some point you're testing prompt generation and what happens with the model, thats what Im talking about. This is a basic session with a couple of people clicking cost that much. So clearly Im doing something far more wrong from the API side to get whats clearly magically worse billing than everyone else here.
Re:ChatGPT's API Is So Good and Cheap, It Makes Most Text Ge... by pharke on Sunday March 12, 2023 @02:53PM (#35124485)
They charge per 1k tokens so you must have high volume somehow, are you maxing out the prompt length every time? That’s the only thing I can think of besides sending a ridiculous number of requests that would cost that much in an evening.