News for hackers. Stuff that matters.

A comment on Performance of llama.cpp on Apple Silicon A-series. Parent comment

Re:Performance of llama.cpp on Apple Silicon A-series by addandsubtract on Wednesday December 20, 2023 @08:17AM (#38708292)
How much RAM do you have? Ollama comes with a note: "this model requires 48GB of RAM".
[ Parent | on HN ]

There are no comments on this comment yet.