How to Train Large Models on Many GPUs?

Re:How to Train Large Models on Many GPUs? by my123 on Saturday February 11, 2023 @08:35PM (#34758555)

Not going to happen:

That unless an utterly revolutionary new interconnect technology comes...

LPDDR is getting adopted more and more too, with CPUs losing memory expansion capabilities in exchange of huge power savings.

[ Parent | on HN ]

Re:How to Train Large Models on Many GPUs? by amelius on Saturday February 11, 2023 @08:41PM (#34758612)

I bet a lot of people would be happy if their GPU could train large models, even if it took 5x as long.

[ Parent | on HN ]

Re:How to Train Large Models on Many GPUs? by my123 on Saturday February 11, 2023 @11:38PM (#34759819)

That's getting a multi-level DRAM config, see Grace Superchip for an example.

Or just a plain slower GPU: Apple's GPU series, but that's at very much higher price tags than desktop GPUs at a given perf level.

[ Parent | on HN ]