News for hackers. Stuff that matters.

A comment on Apple M3 Ultra. Parent comment

Re:Apple M3 Ultra by cubefox on Wednesday March 05, 2025 @05:41PM (#43273743)
I assume even this one won't run on an RTX 5090 due to constrained memory size: https://news.ycombinator.com/item?id=43270843
[ Parent | on HN ]
Re:Apple M3 Ultra by whimsicalism on Wednesday March 05, 2025 @05:50PM (#43273857)
sure on consumer GPUs but that is not what is constraining the model inference in most actual industry setups. technically even then, you are CPU-GPU memory bandwidth bound more than just GPU memory, although that is maybe splitting hairs
[ Parent | on HN ]
Re:Apple M3 Ultra by cubefox on Wednesday March 05, 2025 @06:27PM (#43274228)
Why are industry setups considered actual while others are not?
[ Parent | on HN ]