Re:GPT-4 API General Availability
by nunodonato on Thursday July 06, 2023 @04:19PM
(#36622239)
if you want to use it in prod, go with Azure
[ Parent
| on HN ]
And get only 20 K tokens per minute, where a decent size question can use up 500 tokens, pretty much a joke for most larger websites.
https://learn.microsoft.com/en-us/azure/cognitive-services/o...
Re:GPT-4 API General Availability
by weird-eye-issue on Friday July 07, 2023 @06:00AM
(#36629481)
That's the default limit for GPT-4 which has more demand than any other LLM in the world.
Which is just demonstrating my point, just saying "go use Azure" doesn't solve anything.
Re:GPT-4 API General Availability
by weird-eye-issue on Friday July 07, 2023 @06:45AM
(#36629803)
Yeah for GPT-4 they aren't even accepting new customers