News for hackers. Stuff that matters.
Re:GPT-4 API General Availability by swyx on Thursday July 06, 2023 @04:31PM (#36622497)
> Could it be just my region that is affected?

as far as I know OpenAI only has one region, that is out in Texas.

even more hilariously, as far as I can tell, Azure OpenAI -also- only has one region.. cant imagine why

Re:GPT-4 API General Availability by renewiltord on Thursday July 06, 2023 @04:46PM (#36622731)
Probably compute-bound for inference which they've probably built in an arch-specific way, right? This sort of thing happens. You can't use AVX-512 in Alibaba Cloud cn-hongkong, for instance, because there's no processor available there that can reliably do that (no Genoa CPUs there). I imagine OpenAI has a similar constraint here.
Re:GPT-4 API General Availability by pamelafox on Thursday July 06, 2023 @05:10PM (#36623102)
You can see region availability here for Azure OpenAI:

https://learn.microsoft.com/en-us/azure/cognitive-services/o...

It's definitely limited, but there's currently more than one region available.

(I happen to be working at the moment on a location-related fix to our most popular Azure OpenAI sample, https://github.com/Azure-Samples/azure-search-openai-demo )

Re:GPT-4 API General Availability by benjamoon on Thursday July 06, 2023 @05:12PM (#36623127)
Totally wrong, Azure has loads of regions. We’re using 3 in our app (UK, France and US East). It’s rapid.
Re:GPT-4 API General Availability by swyx on Thursday July 06, 2023 @05:15PM (#36623176)
ah i am out of date then. i was going off this page https://azure.microsoft.com/en-us/pricing/details/cognitive-... which until last month was showing only 1 region
Re:GPT-4 API General Availability by benjamoon on Thursday July 06, 2023 @05:28PM (#36623324)
Whoops, should confirm, we’re using turbo 3.5, not 4.