Megatron-Turing NLG 530B, the World’s Largest Generative Language Model

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by sonic-boom on Monday October 11, 2021 @09:06PM (#28834834)

Any idea if they’ll release an API similar to GPT-3? It’s great that larger and larger models are trained but without enabling access to the trained models developers are left out from the progress…

[ Parent | on HN ]

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by jowday on Monday October 11, 2021 @09:48PM (#28835154)

I hope they don’t release an API the way they released an API for GPT-3.

[ Parent | on HN ]

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by sanxiyn on Tuesday October 12, 2021 @12:08AM (#28835942)

Why? What do you do not like about GPT-3 API?

[ Parent | on HN ]

Re:Megatron-Turing NLG 530B, the World’s Largest Generative ... by nullc on Tuesday October 12, 2021 @12:56AM (#28836226)

Can't fine tune it. Can't use it on private data. Pay per symbol. High latency access. Inconsistent performance. No internet disconnected use. Can't guarentee repeatable results. Can't (easily) replace the sampling with alternatives that have different behavior (e.g. for using it for compression).

[ Parent | on HN ]