GPT-3 APIs are now in public beta

Re:GPT-3 APIs are now in public beta by dave_sullivan on Thursday December 16, 2021 @07:28AM (#29577485)

Yes, but they didn't release the model after training and you can't take your weights with you if you finetune their model.

GPT Neo was trained at similar expense, and they released the weights. Use that.

[ Parent | on HN ]

Re:GPT-3 APIs are now in public beta by damvigilante on Thursday December 16, 2021 @08:00AM (#29577685)

First part is correct, the second part is not. GPT Neo is a 2.7B param model, the largest GPT is 175B (they have various flavours, up to 175B). I appreciate the sentiment and what ElutherAI is doing with GPT Neo, but there is no open source equivlenet of the full GPT-3 available for the public to use. Hopefuly it's just a matter of time.

[ Parent | on HN ]

Re:GPT-3 APIs are now in public beta by priansh on Thursday December 16, 2021 @08:15AM (#29577779)

GPT-J is 6B and comes pretty close. Also practically I haven’t noticed a difference.

Keep in mind there are also closed source alternatives: for example, AI21’s Jurassic-1 models are comparable, cheaper, and technically larger (albeit somewhat comically, 178B instead of 175B parameters).

[ Parent | on HN ]

Re:GPT-3 APIs are now in public beta by ritz_labringue on Thursday December 16, 2021 @07:34AM (#29577511)

Thanks ! Didn't know that. Isn't it also very expensive to run ?

[ Parent | on HN ]