News for hackers. Stuff that matters.

A comment on Running a 180B parameter LLM on a single Apple M2 Ultra. Parent comment

Re:Running a 180B parameter LLM on a single Apple M2 Ultra by AnthonyMouse on Friday September 08, 2023 @03:52AM (#37430771)
But the open source infrastructure is getting built too. And the infrastructure is mostly independent of the model. This is Falcon 180B running using the code from llama.cpp.
[ Parent | on HN ]

There are no comments on this comment yet.