News for hackers. Stuff that matters.

A comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language Model. Parent comment

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by dustfinger on Monday October 11, 2021 @09:21PM (#28834964)
The switch transformer has already achieved a trillion parameters.

https://arxiv.org/abs/2101.03961

[ Parent | on HN ]

There are no comments on this comment yet.