Re:OpenAI has temporarily stopped selling the Plus plan
by jsnell on Tuesday April 04, 2023 @04:28AM
(#35436704)
Uhh... I'm pretty sure that page is about the price of buying an entire GPU that does N GFLOP/S in perpetuity. It has no relevance to the calculation you did, unless you assume the GPU is used for one second and then thrown in the bin.
> I'll acknowledge that a fleet entirely made up of A100 GPUs running at full capacity 100% of the time with Azure's 3-year commitment pricing (likely very low margin) would make this 5 orders of magnitude cheaper. But the sequential nature of transformers makes it difficult to achieve perfect utilization,
I don't think you've thought this through. There's no realistic level of utilization that's going to make up for 5 orders of magnitude. An unimaginably crappy 1% utilization would still leave you off by 3 orders of magnitude.
This very submission about OpenAI having to suspend selling subscriptions makes it pretty clear they're not having trouble with low utilization...
> If ChatGPT plus is $20/mo and each user uses it ~10 times per day, then MS/OpenAI would break even if my estimate were 2 orders of magnitude too high.
You do understand that this doesn't actually support your initial estimate, right? It just makes it more obvious how ridiculous it was.
> I'll acknowledge that a fleet entirely made up of A100 GPUs running at full capacity 100% of the time with Azure's 3-year commitment pricing (likely very low margin) would make this 5 orders of magnitude cheaper. But the sequential nature of transformers makes it difficult to achieve perfect utilization,
I don't think you've thought this through. There's no realistic level of utilization that's going to make up for 5 orders of magnitude. An unimaginably crappy 1% utilization would still leave you off by 3 orders of magnitude.
This very submission about OpenAI having to suspend selling subscriptions makes it pretty clear they're not having trouble with low utilization...
> If ChatGPT plus is $20/mo and each user uses it ~10 times per day, then MS/OpenAI would break even if my estimate were 2 orders of magnitude too high.
You do understand that this doesn't actually support your initial estimate, right? It just makes it more obvious how ridiculous it was.