Re:Apple has new Mac app coming to make running local AI mod...
by LeBit on Wednesday November 11, 2026 @01:41AM
(#50450362)
MacMini with M7 Pro and 96G of RAM.
They are going to sell sure 10,000$ and you won’t need anything else for the rest of your life (if you are over 90).
Btw, llama.cpp with llama-swap ain’t that hard to configure if you have access to a potential LLM and have 5h of your life available to that task.
Re:Apple has new Mac app coming to make running local AI mod...
by apparent on Wednesday November 11, 2026 @02:56AM
(#50450814)
Yeah, I might dive in with llama.cpp at some point, but unless Apple censors the models I can choose I'd just as soon go with Apple's solution.
I also want something that integrates super easily with my iPhone and other devices, and hopefully Apple will make it possible to use my server as an intermediate fallback between my iPhone and their cloud models.
If all of this were easy, I would happily invest in new dedicated hardware to run it. This could be a full-blown Mac or it could be a souped up HomePod-type device, loaded with RAM. Better yet, make it a revitalized Matter-enabled Airport!