News for hackers. Stuff that matters.

A comment on GPT Best Practices. Parent comment

Re:GPT Best Practices by avindroth on Monday June 05, 2023 @11:42PM (#36207786)
That's odd, I have been heavily using GPT-4 API (near 100 requests a day) and didn't notice any errors like that. I noticed maybe 1 or 2 errors with really chat history.
[ Parent | on HN ]
Re:GPT Best Practices by jwr on Tuesday June 06, 2023 @03:03AM (#36209202)
Are your requests above 1400 tokens in size? Requests, not replies.

Small requests (like what most people need) are just fine. It's the larger ones that being to slow down quickly and then break down completely as one gets above 1400 tokens.

[ Parent | on HN ]
Re:GPT Best Practices by zwarag on Tuesday June 06, 2023 @04:40AM (#36209917)
I assume you have access to the beta API?
[ Parent | on HN ]