News for hackers. Stuff that matters.

A comment on GPT-Neo – Building a GPT-3-sized model, open source and free.

Re:GPT-Neo – Building a GPT-3-sized model, open source and free by 2Gkashmiri on Monday January 18, 2021 @04:46AM (#25820036)
So how much money would it take to rebuild this foss alternative ? And distributive power like seti@home? If it can be done and I hope it does, what benefit would the original proprietary one have over this? Licensing?
[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by jne2356 on Monday January 18, 2021 @11:36AM (#25823454)
EleutherAI has already secured the resources necessary.

They get the seti@home suggestion a lot. There's a section in their FAQ that explains why it's infeasible.

https://github.com/EleutherAI/info

[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by astrange on Monday January 18, 2021 @07:28AM (#25821086)
OpenAI will execute the original one for you. If you can get an account, anyway.
[ Parent | on HN ]