Re:OpenAI Major Outage
by lossolo on Wednesday January 25, 2023 @11:56PM
(#34527816)
> 24x 64 GB nodes is 1.5 TB
Looking at your calculations indicates that you mean RAM but it's 1.5 TB GPU VRAM (but this is assuming they use 64 bit precision, which is likely wrong so it's ~750 GB), not RAM.
Looking at your calculations indicates that you mean RAM but it's 1.5 TB GPU VRAM (but this is assuming they use 64 bit precision, which is likely wrong so it's ~750 GB), not RAM.