News for hackers. Stuff that matters.

A comment on Performance of llama.cpp on Apple Silicon A-series. Parent comment

Re:Performance of llama.cpp on Apple Silicon A-series by yieldcrv on Tuesday December 19, 2023 @06:58PM (#38703703)
I use LM Studio and 0.2.9 now has a checkmark for it
[ Parent | on HN ]
Re:Performance of llama.cpp on Apple Silicon A-series by addandsubtract on Wednesday December 20, 2023 @08:17AM (#38708292)
How much RAM do you have? Ollama comes with a note: "this model requires 48GB of RAM".
[ Parent | on HN ]