Meta MTIA v2 - Hackdot

Re:Meta MTIA v2 by samspenc on Wednesday April 10, 2024 @06:07PM (#39996206)

Is there a better way to compare performance across these high-end chips? The only comparable numbers I was able to find were the TFLOPS.

Meta seems to be reported these numbers for this v2 chip:

    708 TFLOPS/s (INT8) (sparsity)
    354 TFLOPS/s (INT8)

And I see Nvidia reporting these numbers for its latest Blackwell chips https://www.anandtech.com/show/21310/nvidia-blackwell-archit...

    4500 T(FL)OPS INT8/FP8 Tensor

Am I understanding correctly that Nvidia's upcoming Blackwell chips are 5-10x faster than this one Meta just announced?

[ Parent | on HN ]

Re:Meta MTIA v2 by ipsum2 on Wednesday April 10, 2024 @07:36PM (#39996816)

To a rough approximation, yes. The blackwell chip is also ~10x larger in surface area than MTIA, so the costs are proportional.

[ Parent | on HN ]