Re:AMD Launches Instinct MI300X AI Accelerator, Up to 60% Fa...
by idonotknowwhy on Wednesday December 06, 2023 @05:34PM
(#38550424)
I'm hoping for the same thing, but with Intel ARC.
Intel gpus are cheaper, but have even worse ML software for consumer projects
[ Parent
| on HN ]
Re:AMD Launches Instinct MI300X AI Accelerator, Up to 60% Fa...
by frognumber on Wednesday December 06, 2023 @06:41PM
(#38551010)
I'm optimistic.
* Intel has a history of getting this type of software working.
* AMD doesn't.
I don't think I'll ever trust AMD after... experiences, but Intel I'm bullish on Intel.
Arc A770 seems like by far the bang for the buck once software lands. 16GB for $300 if you find a good deal. Decent performance. Stick four of them in a system, and you've got 64GB for $1200 and a pretty decent amount of compute. Buy five systems like that, and you can run the largest open-source LLMs out there with Alpa for ~$6K.
That brings Facebook's GPT3-grade OPT models from corporate down to serious enthusiast level.