News for hackers. Stuff that matters.

A comment on Running a 180B parameter LLM on a single Apple M2 Ultra. Parent comment

Re:Running a 180B parameter LLM on a single Apple M2 Ultra by anurag6892 on Thursday September 07, 2023 @01:46PM (#37422761)
this advantage is not specific to OpenAI right? Any big cloud provider like Amazon/Google can host these open LLM models.
[ Parent | on HN ]
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by smoldesu on Thursday September 07, 2023 @01:48PM (#37422795)
It's not exclusive, no. At OpenAI's scale though, they can afford to purchase their own hardware like a big cloud provider can. It's likely that OpenAI was running Nvidia's DGX servers in production before AWS and GCP even got their unit quotes.
[ Parent | on HN ]
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by nerbert on Thursday September 07, 2023 @04:10PM (#37424905)
OpenAI's got the first mover advantage. It's everything if you don't fuck up.
[ Parent | on HN ]