Re:Running a 180B parameter LLM on a single Apple M2 Ultra
by smoldesu on Thursday September 07, 2023 @01:48PM
(#37422795)
It's not exclusive, no. At OpenAI's scale though, they can afford to purchase their own hardware like a big cloud provider can. It's likely that OpenAI was running Nvidia's DGX servers in production before AWS and GCP even got their unit quotes.
[ Parent
| on HN ]
There are no comments on this comment yet.