Megatron-Turing NLG 530B, the World’s Largest Generative Language Model Posted by ruuda on Monday October 11, 2021 @03:19PM from the microsoft.com dept. https://www.microsoft.com/en-us/research/blog/using-deepspeed-and-megatron-to-train-megatron-turing-nlg-530b-the-worlds-largest-and-most-powerful-generative-language-model/ ( 1 comment | 3 points | on HN )
It’s great that larger and larger models are trained but without enabling access to the trained models developers are left out from the progress…