Re:OpenAI is too cheap to beat
by KaiserPro on Thursday October 12, 2023 @05:44PM
(#37863562)
> Or are they just operating at a massive loss to kill off other competition?
Bingo.
> the deal with Microsoft for cloud services making it cheap?
It should make it cheaper, but it takes time and engineers to migrate work load from AWS (which is reasonably adept at scaling) to azure, which is not.
I think they run k8s in something like 4k groups of nodes, which is spectacular, because k8s isn't really designed to do that. Running it at that scale is challenging because the traffic required to coordinate is massive (well it was last time I looked into it.)
Bingo.
> the deal with Microsoft for cloud services making it cheap?
It should make it cheaper, but it takes time and engineers to migrate work load from AWS (which is reasonably adept at scaling) to azure, which is not.
I think they run k8s in something like 4k groups of nodes, which is spectacular, because k8s isn't really designed to do that. Running it at that scale is challenging because the traffic required to coordinate is massive (well it was last time I looked into it.)