Re:Apple M3 Ultra
by behnamoh on Wednesday March 05, 2025 @09:46AM
(#43267133)
except that you cannot run multiple language models on Apple Silicon in parallel
[ Parent
| on HN ]
I'm curious why not. I am running a few different models on my mac studio. I'm using llama.cpp, and it performs amazingly fast for the $7k I spent.
I said in parallel.