News for hackers. Stuff that matters.

A comment on Megatron-Turing NLG 530B, the World’s Largest Generative Language Model. Parent comment

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by EvgeniyZh on Monday October 11, 2021 @01:58PM (#28831028)
Not all weights are born equal, different paradigms allow more parameters while being less parameter-efficient, e.g. https://openreview.net/forum?id=TXqemS7XEH
[ Parent | on HN ]

There are no comments on this comment yet.