News for hackers. Stuff that matters.
Re:Apple M3 Ultra by bearjaws on Wednesday March 05, 2025 @11:00AM (#43268344)
Not sure why you are being downvoted, we already know the performance numbers due to memory bandwidth constraints on the M4 Max chips, it would apply here as well.

525GB/s to 1000GB/s will double the TPS at best, which is still quite low for large LLMs.

Re:Apple M3 Ultra by lanceflt on Wednesday March 05, 2025 @01:50PM (#43270616)
Deepseek R1 (full, Q1) is 14t/s on an M2 Ultra, so this should be around 20t/s