News for hackers. Stuff that matters.

A comment on Accelerated PyTorch Training on M1 Mac. Parent comment

Re:Accelerated PyTorch Training on M1 Mac by visarga on Wednesday May 18, 2022 @05:21PM (#31427834)
GPT-3 sized models need that kind of memory for inference
[ Parent | on HN ]
Re:Accelerated PyTorch Training on M1 Mac by sudosysgen on Wednesday May 18, 2022 @05:25PM (#31427888)
GPT-3 is more like 300GB iirc
[ Parent | on HN ]