Re:Notes on training BERT from scratch on an 8GB consumer GPU
by Zemtomo on Friday June 02, 2023 @06:45AM
(#36163478)
That would be only true if gamer have a relevant overlap.
While it's a nice Sidebonus for people gaming, I would argue a better point is the current Nvidia strategy to starve their line of 40* with memory and it's much easier to get a 8gb card than anything else.
I got a 4090 primarily for the 24gb.
Re:Notes on training BERT from scratch on an 8GB consumer GPU
by Havoc on Friday June 02, 2023 @08:40AM
(#36164292)
If you want to encourage grass roots learning interest millions of gamers with 8gb cards is a better starting point. Even if only a small percentage go for it that's still million of people.
Meanwhile the number of people that has the luxury of shelling out for a 4090 straight away for AI specifically is pretty small.
It's a bit like raspberry pis helped the tinkering world even though they're realistically slow AF. (and now unobtainable sigh)
6gb - 19%
8gb - 28%
12gb - 11%
rest, mostly <6gb
So staying below 8 helps open thing up to a lot of tinkerers in a sorta democratic sense.
https://store.steampowered.com/hwsurvey/Steam-Hardware-Softw...