News for hackers. Stuff that matters.

A comment on Running a 180B parameter LLM on a single Apple M2 Ultra. Parent comment

Re:Running a 180B parameter LLM on a single Apple M2 Ultra by foobiekr on Friday September 08, 2023 @12:46AM (#37429443)
I think you are overestimating R&D budgets for companies. Very few tech companies - even large ones - have R&D budgets in the $10B+ range, let alone $100B. Most of the fortune 100 isn't even $10B.
[ Parent | on HN ]
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by danielbln on Friday September 08, 2023 @02:12AM (#37430039)
Where do you get $100B from?
[ Parent | on HN ]
Re:Running a 180B parameter LLM on a single Apple M2 Ultra by foobiekr on Friday September 08, 2023 @12:43PM (#37435993)
"orders of magnitude"
[ Parent | on HN ]