News for hackers. Stuff that matters.

A comment on GPT-Neo – Building a GPT-3-sized model, open source and free.

Re:GPT-Neo – Building a GPT-3-sized model, open source and free by Havoc on Monday January 18, 2021 @06:24AM (#25820618)
Would be good if this could decentralized bittorrent/BOINC style somehow.

Wouldn't mind contributing some horsepower

[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by jne2356 on Monday January 18, 2021 @03:05PM (#25825962)
They get this suggestion a lot. There's a section in their FAQ that explains why it's infeasible.

https://github.com/EleutherAI/info

[ Parent | on HN ]
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by Havoc on Tuesday January 19, 2021 @06:33PM (#25840452)
I see. THanks for highlighting that. Makes sense unfortunately
[ Parent | on HN ]