Memory bandwidth M1: 68 GB/s M2: 100 GB/s (47% increase) M3: 100 GB/s (0% increase) M4: 120 GB/s (20% increase) M5: 153 GB/s (27.5% increase)
So, M6: 170 GB/s (11% increase) doesn’t seem impossible, though I would have expected more.
[0]: https://www.jdhodges.com/blog/apple-cpu-compared-m1-m3-m3-m4...
Eg the M4 Max 128GB has a bandwidth speed of 500GB/s+. And that's true for other models as well.
But as you note, the base speed has also increased over the versions.
Historically the Pro doubles the base, the Max doubles the Pro, and the Ultra doubles the Max.
If an M6 ultra were released today it would be 1.36TB/s.
https://blog.exolabs.net/nvidia-dgx-spark/ outlines a combination of a DGX Spark and an M3 Ultra that took advantage of fast prefill on the Nvidia hardware and fast decode on Apple Silicon.
Using the published bandwidths, the math is 170 * 1 and 153 * 8.
Even the GTX 1080, launched ten years ago, has double the bandwidth!
This must be some different way of measuring the bandwidth right? Since they explicitly say this for AI, but the numbers they share don't show that at all. Or I gravely misunderstand something here.