Zero-Infinity and DeepSpeed: single GPU to finetune GPT-3 175B parameters Posted by ghosthamlet on Monday April 19, 2021 @09:26PM from the microsoft.com dept. https://www.microsoft.com/en-us/research/blog/zero-infinity-and-deepspeed-unlocking-unprecedented-model-scale-for-deep-learning-training/? ( no comments | 3 points | on HN )
There are no comments yet.