Nvidia Unveils GeForce RTX 30 Series GPUs

Re:Nvidia Unveils GeForce RTX 30 Series GPUs by godelski on Tuesday September 01, 2020 @01:21PM (#24344189)

Being in the ML space myself I can tell you that memory is pretty important. With my current workload (vision tasks) it is my largest constraint.

That said, rumor has it that they will announce a 20Gb 3080 later.

[ Parent | on HN ]

Re:Nvidia Unveils GeForce RTX 30 Series GPUs by abledon on Tuesday September 01, 2020 @02:36PM (#24345178)

and its a 20gb with the ability to do FP16 right? So theoritcally lots of the models can actually be 40gb?

[ Parent | on HN ]

Re:Nvidia Unveils GeForce RTX 30 Series GPUs by atty on Tuesday September 01, 2020 @07:05PM (#24348155)

Well, they can be 40 GB fp32 models technically, but translating a model trained in fp32 to fp16 is not trivial (trust me, we’re working on this right now for a model). But remember that training the model requires a lot more memory than just the model parameters, because you need to store the gradients as well.

[ Parent | on HN ]