News for hackers. Stuff that matters.

A comment on How to Train Large Models on Many GPUs?. Parent comment

Re:How to Train Large Models on Many GPUs? by amelius on Saturday February 11, 2023 @08:41PM (#34758612)
I bet a lot of people would be happy if their GPU could train large models, even if it took 5x as long.
[ Parent | on HN ]
Re:How to Train Large Models on Many GPUs? by my123 on Saturday February 11, 2023 @11:38PM (#34759819)
That's getting a multi-level DRAM config, see Grace Superchip for an example.

Or just a plain slower GPU: Apple's GPU series, but that's at very much higher price tags than desktop GPUs at a given perf level.

[ Parent | on HN ]