News for hackers. Stuff that matters.

A comment on Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM. Parent comment

Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM by fyzix on Tuesday June 06, 2023 @02:21PM (#36216995)
Max to ultra doesn't scale linearly. Max tech on YouTube covered this extensively
[ Parent | on HN ]
Re:Nvidia releases new AI chip with 480GB CPU RAM, 96GB GPU RAM by joakleaf on Tuesday June 06, 2023 @03:00PM (#36217498)
Probably true that performance doesn't scale linearly (and I do remember the Max Tech analysis of M1), but I don't have the tflops number for the M2 ultra.

For the M1 the stated values are:

  M1 Ultra [1]: 21 TFLOPs
  M1 Max [2]: 10.6 TFLOPS
Actual performance obviously depends on the type of work-load etc. E.g. Geekbench Ultra is only 50% faster [3]:

  M1 Ultra Geekbench 6: 150260 
  M1 Max Geekbench 6: 108198
[1] https://videocardz.com/newz/despite-apples-claims-m1-ultra-g... [2] https://wccftech.com/m1-max-teraflops-performance-higher-tha... [3] https://browser.geekbench.com/metal-benchmarks
[ Parent | on HN ]