Re:Azure announces new AI optimized VM series featuring AMD'...
by treprinum on Wednesday November 15, 2023 @03:20PM
(#38281899)
That's the joke. It still is. ROCm is nowhere near production-ready and if MS thinks devs will want to waste their time on random errors then good luck with that business. AMD cards are also super expensive so not sure what their competitiveness is supposed to be?
[ Parent
| on HN ]
Re:Azure announces new AI optimized VM series featuring AMD'...
by latchkey on Wednesday November 15, 2023 @03:22PM
(#38281921)
Expensive is not entirely relevant. They are available (for now).
https://twitter.com/sama/status/1724626002595471740
ROCm has also made a lot of advances in recent times.
https://www.databricks.com/blog/training-llms-scale-amd-mi25...
Re:Azure announces new AI optimized VM series featuring AMD'...
by kristianp on Wednesday November 15, 2023 @05:25PM
(#38283480)
Thread about that tweet (or should I say xeet) from SamA: https://news.ycombinator.com/item?id=38274427
Re:Azure announces new AI optimized VM series featuring AMD'...
by epolanski on Wednesday November 15, 2023 @03:23PM
(#38281936)
Microsoft can develop their own software. We are talking a company that places billions in orders to Nvidia, they can afford to develop the tools and obviously AMD will throw millions and millions in support to court such a customer.
Re:Azure announces new AI optimized VM series featuring AMD'...
by brucethemoose2 on Wednesday November 15, 2023 @03:53PM
(#38282326)
The MI300 is a massive GPU compared to even the new H200.
It was designed as a combined CPU/GPU for supercomputers, with shared memory. But then the AI craze hit, so AMD spun a variant into a pure GPU AI accelerator real quick, which they could actually pull off because the GPU silicon is modular.
...So thats why it cost a fortune. Its really a jury rigged HPC product.
Re:Azure announces new AI optimized VM series featuring AMD'...
by pclmulqdq on Wednesday November 15, 2023 @06:41PM
(#38283987)
The H100 is, to some degree, also a jury rigged HPC product. The H200 is starting to reach a more "AI" balance between compute and memory bandwidth.
Re:Azure announces new AI optimized VM series featuring AMD'...
by treprinum on Wednesday November 15, 2023 @07:41PM
(#38284482)
I can see MI300 being used for CFD, nuclear physics simulation, cloud GPU virtualization etc. but for AI it's simply not there regardless of AMD's and its affiliated startups' marketing.
Re:Azure announces new AI optimized VM series featuring AMD'...
by latchkey on Wednesday November 15, 2023 @08:00PM
(#38284640)
You're thinking the MI250. MI300x is a beast for AI.