News for hackers. Stuff that matters.
Re:GPT-4 API General Availability by hobs on Thursday July 06, 2023 @04:54PM (#36622867)
And get only 20 K tokens per minute, where a decent size question can use up 500 tokens, pretty much a joke for most larger websites.

https://learn.microsoft.com/en-us/azure/cognitive-services/o...

Re:GPT-4 API General Availability by weird-eye-issue on Friday July 07, 2023 @06:00AM (#36629481)
That's the default limit for GPT-4 which has more demand than any other LLM in the world.
Re:GPT-4 API General Availability by hobs on Friday July 07, 2023 @06:40AM (#36629764)
Which is just demonstrating my point, just saying "go use Azure" doesn't solve anything.
Re:GPT-4 API General Availability by weird-eye-issue on Friday July 07, 2023 @06:45AM (#36629803)
Yeah for GPT-4 they aren't even accepting new customers