News for hackers. Stuff that matters.

A comment on How to Train Large Models on Many GPUs?. Parent comment

Re:How to Train Large Models on Many GPUs? by amelius on Saturday February 11, 2023 @04:14PM (#34756423)
> Why isn't there a framework that does all this automatically for you?

Question: could this be implemented in PyTorch in an opaque way? Or would it require changes to its API?

[ Parent | on HN ]

There are no comments on this comment yet.