AMD Expands AI Product Lineup with GPU-Only Instinct Mi300X with 192GB Memory

Re:AMD Expands AI Product Lineup with GPU-Only Instinct Mi30... by mindcrime on Tuesday June 13, 2023 @06:24PM (#36318447)

And still, if you'd actually have to risk money, you and me both know you'd never invest in AMD hardware for AI or start developing on it something high stakes.

I assume you meant "you" in the royal sense. Since I personally am, in point of fact, investing in AMD hardware for AI. Yeah, it's a gamble, but that's my style. And I have to admit, part of it is driven by ideological reasons (ROCm being open source) and a simple desire to support AMD since I want them to become a serious competitor to NVIDIA. I believe that's an outcome that would benefit everybody.

I mean, look at geohot he tried and just gave up entirely and AMD.

I have to admit, I don't find that particularly compelling in any regard. Nothing against geohot, he's clearly a smart dude, but... I'm not judging a company based on his interactions with them. shrug

[ Parent | on HN ]

Re:AMD Expands AI Product Lineup with GPU-Only Instinct Mi30... by zwaps on Tuesday June 13, 2023 @06:31PM (#36318530)

I wish you luck then. Right now, you need CUDA to run things like bf16 or quantization, which are truly enablers in this space.

So for now, I don't see AMD getting any traction. And apparently, the quality of the drivers has not been improving. Time will tell.

[ Parent | on HN ]

Re:AMD Expands AI Product Lineup with GPU-Only Instinct Mi30... by mindcrime on Tuesday June 13, 2023 @06:39PM (#36318609)

Agreed. And FWIW, I'm not saying I use AMD kit exclusively. I'm fine with using NVIDIA hardware and CUDA when needed. In addition to the AMD based box I'm building for the lab at home, I'm also building a sister box which will be nearly identical, except using an NVIDIA GPU. I am an ideologue but I'm also at least a little bit pragmatic. :-)

[ Parent | on HN ]