News for hackers. Stuff that matters.
Re:Apple M3 Ultra by behnamoh on Wednesday March 05, 2025 @09:46AM (#43267133)
except that you cannot run multiple language models on Apple Silicon in parallel
Re:Apple M3 Ultra by kevin42 on Wednesday March 05, 2025 @10:20AM (#43267695)
I'm curious why not. I am running a few different models on my mac studio. I'm using llama.cpp, and it performs amazingly fast for the $7k I spent.
Re:Apple M3 Ultra by behnamoh on Wednesday March 05, 2025 @03:55PM (#43272261)
I said in parallel.
Re:Apple M3 Ultra by saagarjha on Thursday March 06, 2025 @02:53AM (#43277589)
Surely you can run smaller models together