Re:GPT Best Practices
by jwr on Tuesday June 06, 2023 @03:03AM
(#36209202)
Are your requests above 1400 tokens in size? Requests, not replies.
Small requests (like what most people need) are just fine. It's the larger ones that being to slow down quickly and then break down completely as one gets above 1400 tokens.
Small requests (like what most people need) are just fine. It's the larger ones that being to slow down quickly and then break down completely as one gets above 1400 tokens.