Re:Nvidia Unveils GeForce RTX 30 Series GPUs
by i-am-curious on Tuesday September 01, 2020 @02:27PM
(#24345068)
This is a misleading comparison. You are comparing a massive model with huge models. What you should be comparing are big models vs medium models that a single consumer GPU will fit. And - you don't need to take my word for it, there's tons of papers - the bigger models definitely perform better.
Re:Nvidia Unveils GeForce RTX 30 Series GPUs
by benlivengood on Tuesday September 01, 2020 @03:19PM
(#24345808)
The human brain has about 100 trillion synapses which is a closer analog to ML model parameters.
Re:Nvidia Unveils GeForce RTX 30 Series GPUs
by junipertea on Tuesday September 01, 2020 @03:53PM
(#24346255)
It can't do long division because it literally can't read the number inputs, due to the way text is encoded (BPE). That it manages to learn any sort of arithmetic despite that is pretty impressive to me.
Even a billion parameters is a huge model, and a factor of 2.4x increase is not going to make a tremendous difference in your performance. In particular the data-heavy nature of vision stuff means that you'll be bottlenecked by training more than memory, AFAIK (again, lay).