News for hackers. Stuff that matters.
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by smoldesu on Thursday September 07, 2023 @01:48PM (#37422795)
It's not exclusive, no. At OpenAI's scale though, they can afford to purchase their own hardware like a big cloud provider can. It's likely that OpenAI was running Nvidia's DGX servers in production before AWS and GCP even got their unit quotes.

There are no comments on this comment yet.