Re:Sam Altman returns as CEO, OpenAI has a new initial board
by asimpleusecase on Thursday November 30, 2023 @12:19AM
(#38469964)
This pushed our small team to try Azure instance of GPT3.5 - wow 20 times faster. API does not fail to respond to server requests as we found oh so often on the OpenAI API. We now have something fast enough and stable enough to actually use. Pricing is higher, but my goodness, it actually works.
[ Parent
| on HN ]
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by moontear on Thursday November 30, 2023 @01:54AM
(#38470513)
Pricing higher is funny because OpenAI fully runs on Azure.
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by 7734128 on Thursday November 30, 2023 @01:57AM
(#38470538)
It's a bit different to have an instance always prepared for your use and to use a shared infrastructure. The latter could pretty much always expect at least a few percent use, which would reduce price.
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by vegarab on Thursday November 30, 2023 @03:37AM
(#38471191)
Why? The Azure API comes with an SLA and support.
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by raverbashing on Thursday November 30, 2023 @01:56AM
(#38470531)
As much as I'm sure people on OpenAI are good, they're focused on the research and math of the thing, but lack in Ops experience
(though to be honest I think Azure API was flaky yesterday)
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by danielbln on Thursday November 30, 2023 @02:56AM
(#38470888)
Considering the complexities involved and the outrageous amount of MAUs OpenAI has on their platform and yet them north of 99.8% uptime (ok, November was worse with 99,20%), saying they lack Ops experience is ludicrous.
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by raverbashing on Thursday November 30, 2023 @03:25AM
(#38471117)
Oh I'm sure they have competent people
But compared to FB, MS, Google etc they are probably still behind (both in infrastructure and maturity)
Re:Sam Altman returns as CEO, OpenAI has a new initial board
by quickthrower2 on Thursday November 30, 2023 @06:17AM
(#38472152)
Hows everyone finding Azure? I’m an Azure bread and butter user but I am sure people mostly on AWS are having fun with Azures CLIs APIs Portal etc. because it is going to be a lot different and unfamiliar. Also egress/ingress costs although mostly the AI costs would far exceed that anyway.