Re:Notes on training BERT from scratch on an 8GB consumer GPU
by jacquesm on Friday June 02, 2023 @06:48AM
(#36163496)
A bit of both, NV has put a ton of work in their software libraries which makes doing some stuff on NV a viable option, you'd have to do a lot of work to get to an equivalent level on AMD.
But if all you need is PyTorch support then AMD may well be a viable option.
But if all you need is PyTorch support then AMD may well be a viable option.