News for hackers. Stuff that matters.
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by danwills on Monday January 18, 2021 @04:59AM (#25820133)
Yeah! sounds great, if I could easily run a SETI-at-home style thing to contribute to training a (future) model similar to GPT-x, but with the result freely available to play with, I reckon i'd do it. Could even be made into a game I'd say! I am totally aware that gpt3 itself can't be run on a regular workstation, but maybe hosting for instances of models from the best/most-interesting training runs could be worked out by crowd-funding?
Re:GPT-Neo – Building a GPT-3-sized model, open source and free by colobas on Monday January 18, 2021 @02:36PM (#25825628)
I was just gonna propose something like this. Democratizing large ML models.