News for hackers. Stuff that matters.
Re:Azure announces new AI optimized VM series featuring AMD'... by brucethemoose2 on Wednesday November 15, 2023 @03:53PM (#38282326)
The MI300 is a massive GPU compared to even the new H200.

It was designed as a combined CPU/GPU for supercomputers, with shared memory. But then the AI craze hit, so AMD spun a variant into a pure GPU AI accelerator real quick, which they could actually pull off because the GPU silicon is modular.

...So thats why it cost a fortune. Its really a jury rigged HPC product.

Re:Azure announces new AI optimized VM series featuring AMD'... by pclmulqdq on Wednesday November 15, 2023 @06:41PM (#38283987)
The H100 is, to some degree, also a jury rigged HPC product. The H200 is starting to reach a more "AI" balance between compute and memory bandwidth.
Re:Azure announces new AI optimized VM series featuring AMD'... by treprinum on Wednesday November 15, 2023 @07:41PM (#38284482)
I can see MI300 being used for CFD, nuclear physics simulation, cloud GPU virtualization etc. but for AI it's simply not there regardless of AMD's and its affiliated startups' marketing.
Re:Azure announces new AI optimized VM series featuring AMD'... by latchkey on Wednesday November 15, 2023 @08:00PM (#38284640)
You're thinking the MI250. MI300x is a beast for AI.
Re:Azure announces new AI optimized VM series featuring AMD'... by treprinum on Thursday November 16, 2023 @11:01AM (#38291166)
Vega was an ML monster on paper as well, handily beating 1080Ti. Then the reality set in...
Re:Azure announces new AI optimized VM series featuring AMD'... by latchkey on Thursday November 16, 2023 @11:04AM (#38291192)
These aren’t consumer cards. Apples and oranges.