News for hackers. Stuff that matters.

A comment on Apple M3 Ultra. Parent comment

Re:Apple M3 Ultra by mrtksn on Wednesday March 05, 2025 @09:51AM (#43267243)
How many t/s would you expect? I think I feel perfectly fine when its over 50.

Also, people figured a way to run these things in parallel easily. The device is pretty small, I think for someone who wouldn't mind the price tag stacking 2-3 of those wouldn't be that bad.

[ Parent | on HN ]
Re:Apple M3 Ultra by yk on Wednesday March 05, 2025 @10:06AM (#43267511)
I think I've seen 800 GB/s memory bandwidth, so a q4 quant of a 400 B model should be 4 t/s if memory bound.
[ Parent | on HN ]
Re:Apple M3 Ultra by behnamoh on Wednesday March 05, 2025 @09:55AM (#43267314)
I know you’re referring to the exolabs app, but the t/s is really not that good. it uses thunderbolt instead of NVlink.
[ Parent | on HN ]