News for hackers. Stuff that matters.

A comment on Apple M3 Ultra. Parent comment

Re:Apple M3 Ultra by matt-p on Wednesday March 05, 2025 @01:47PM (#43270584)
That config would also use about 10x the power, and you still wouldn't be able to run a model over 32GB whereas the studio can easily cope with 70B llama and plenty of space to grow.

I think it actually is perfect for local inference in a way that build or any other pc build in this price range would be.

[ Parent | on HN ]
Re:Apple M3 Ultra by kllrnohj on Wednesday March 05, 2025 @01:50PM (#43270606)
The M3 Ultra studio also wouldn't be able to run path traced Cyberpunk at all no matter how much RAM it has. Workloads other than local inference LLMs exist, you know :) After all, if the only thing this was built to do was run LLMs then they wouldn't have bothered adding so many CPU cores or video engines. CPU cores (along with networking) being 2 of the specs highlighted by the person I was responding to, so they were obviously valuing more than just LLM use cases.
[ Parent | on HN ]
Re:Apple M3 Ultra by kridsdale1 on Wednesday March 05, 2025 @02:42PM (#43271298)
The core customer market for this thing remains Video Editors. That’s why they talk about simultaneous 8K encoding streams.

Apple’s Pro segment has been video editors since the 90s.

[ Parent | on HN ]
Re:Apple M3 Ultra by dagmx on Wednesday March 05, 2025 @08:14PM (#43275008)
Bad game example because cyberpunk with raytracing is coming to macOS and will run on this.
[ Parent | on HN ]
Re:Apple M3 Ultra by hot_gril on Wednesday March 05, 2025 @08:18PM (#43275052)
Well that's what (s)he meant, the Mac Studio fits the AI use case but not other ones so much.
[ Parent | on HN ]