Re:Notes on training BERT from scratch on an 8GB consumer GPU
by giomasce on Friday June 02, 2023 @06:45AM
(#36163475)
Is that because AMD GPUs are technically inferior for ML, or because of tooling is only written for NVIDIA?
[ Parent
| on HN ]
Re:Notes on training BERT from scratch on an 8GB consumer GPU
by jacquesm on Friday June 02, 2023 @06:48AM
(#36163496)
A bit of both, NV has put a ton of work in their software libraries which makes doing some stuff on NV a viable option, you'd have to do a lot of work to get to an equivalent level on AMD.
But if all you need is PyTorch support then AMD may well be a viable option.