News for hackers. Stuff that matters.
Re:MK1 Flywheel Unlocks the Full Potential of AMD Instinct f... by hereme888 on Monday January 08, 2024 @12:18AM (#38908573)
Isn't this an unfair comparison, given they test the A6000 Ampere (half the price of MI210) instead of the Ada generation (still a cheaper than the MI210, but ~2x the CUDA cores as Ampere)?
Re:MK1 Flywheel Unlocks the Full Potential of AMD Instinct f... by paul_mk1 on Monday January 08, 2024 @12:58AM (#38908757)
Comparisons between different chip architectures are imperfect. In our opinion the most fair thing to do is 1) match the TFLOPs (since these workloads are compute bound), and 2) find a similar card that can run the same size models. Since MI210 has 64GB, the closest one is the A6000 with 48GB. Many of the less expensive ADA cards can't even fit a 13B model in VRAM, so a comparison could not even be made.
Re:MK1 Flywheel Unlocks the Full Potential of AMD Instinct f... by hereme888 on Monday January 08, 2024 @02:05AM (#38909023)
Oh I get it: you're matching compute hardware capability to test the performance of your software. Thanks! (and good job!)
Re:MK1 Flywheel Unlocks the Full Potential of AMD Instinct f... by nnevatie on Monday January 08, 2024 @03:03AM (#38909313)
I have an Ada 6000 installed here. How can I test this?