News for hackers. Stuff that matters.

A comment on OpenAI's GPT-3 may be the biggest thing since Bitcoin.

Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by person_of_color on Saturday July 18, 2020 @09:54PM (#23886375)
How does one build a GPT-3 instance on a home workstation?
[ Parent | on HN ]
Re:OpenAI's GPT-3 may be the biggest thing since Bitcoin by ca_parody on Saturday July 18, 2020 @11:04PM (#23886691)
Sadly one doesn't - unless one happens to have ~300GB of RAM to fit the model into memory and a close personal friend at openai who will share the learned weights with you. Training your an even more expensive endeavor.

Presumably this is how they are justifying the for-a-price API; "its not like you can run it on your home computer anyway". For now, the API is private and geared towards researchers. Still a bit bollocks though.

There are plenty of wrappers [0] around GPT2 though - and those you can probably run on your home workstation.

_ [0] https://pypi.org/project/gpt2-client/

[ Parent | on HN ]