Re:AI cloud startup TensorWave bets AMD can beat Nvidia
by dark__paladin on Tuesday April 16, 2024 @07:39AM
(#40050778)
rocBLAS/hipBLAS are pretty solid. You're on the money with AMD's implementations of LAPACK not being up to snuff, though.
A 15k AMD part vs a 60k nvidia part. For 100 Nvidia GPUs, you can buy 200 AMD GPUs and at least 2-3 engineers for 3 years at 300k to fix the specific library for that GPU. If you can make that work for a lower level library right now, then it makes to sustain it in future.