News for hackers. Stuff that matters.
Re:ChatGPT API – How do I handle the 4000 token limit for ke... by bob1029 on Sunday March 05, 2023 @09:08AM (#35029703)
Prompt engineering & fine-tuning are the strategic solution.

https://platform.openai.com/docs/guides/fine-tuning

It can be cheaper to use a more expensive model (in terms of tokens/$) if it can be tuned with the same context you'd have to otherwise send with every prompt.

Right now, gpt-3.5-turbo cannot be tuned, so you must fit everything in the 4k limit. There are 4 other models that can be tuned.

There are no comments on this comment yet.