Running a 180B parameter LLM on a single Apple M2 Ultra

Re:Running a 180B parameter LLM on a single Apple M2 Ultra by visarga on Thursday September 07, 2023 @12:52PM (#37421862)

> I think people will be surprised that consumers ultimately end up benefitting far more from LLMs than the providers.

LLMs make possible the great skill sharing, they are learning from some people through web and books, and then assist other people in their particular problems. This level of sharing and customisation is even greater and more accessible than open source.

[ Parent | on HN ]

Re:Running a 180B parameter LLM on a single Apple M2 Ultra by passion__desire on Thursday September 07, 2023 @02:07PM (#37423105)

All the great points Salman Khan made about Khan Academy in his famous ted talk apply here. The only difference is LLMs can go from Eli5 to EliPhD in just few back and forth. Then to put cherry on the top, you can ask it summarize the conversation in a poem written in style of Walt Whitman.

[ Parent | on HN ]