Re:Azure announces new AI optimized VM series featuring AMD'...
by pclmulqdq on Wednesday November 15, 2023 @06:41PM
(#38283987)
The H100 is, to some degree, also a jury rigged HPC product. The H200 is starting to reach a more "AI" balance between compute and memory bandwidth.
Re:Azure announces new AI optimized VM series featuring AMD'...
by treprinum on Wednesday November 15, 2023 @07:41PM
(#38284482)
I can see MI300 being used for CFD, nuclear physics simulation, cloud GPU virtualization etc. but for AI it's simply not there regardless of AMD's and its affiliated startups' marketing.
Re:Azure announces new AI optimized VM series featuring AMD'...
by latchkey on Wednesday November 15, 2023 @08:00PM
(#38284640)
You're thinking the MI250. MI300x is a beast for AI.
It was designed as a combined CPU/GPU for supercomputers, with shared memory. But then the AI craze hit, so AMD spun a variant into a pure GPU AI accelerator real quick, which they could actually pull off because the GPU silicon is modular.
...So thats why it cost a fortune. Its really a jury rigged HPC product.