News for hackers. Stuff that matters.
Re:GPT-3 is no longer the only game in town by nathias on Sunday November 07, 2021 @11:46AM (#29141003)
Yes, this is an old idea (which I really like) but it hasn't really taken off yet. GridCoin was one example, where you solved BOINC problems or RLC that's for more general computation.
Re:GPT-3 is no longer the only game in town by rewq4321 on Sunday November 07, 2021 @11:50AM (#29141057)
The problem is that, currently, large ML models need to be trained on clusters of tightly-connected GPUs/accelerators. So it's kinda useless having a bunch of GPUs spread all over the world with huge latency and low bandwidth between them. That may change though - there are people working on it: https://github.com/learning-at-home/hivemind
Re:GPT-3 is no longer the only game in town by Kiro on Sunday November 07, 2021 @11:51AM (#29141074)
It hasn't taken off because it doesn't work. PoW only works for things that are hard to calculate but easy to verify. Any meaningful result is equally hard to verify.
Re:GPT-3 is no longer the only game in town by petters on Sunday November 07, 2021 @12:30PM (#29141474)
> Any meaningful result is equally hard to verify.

This is very much not true. A central class in complexity is NP whose problems are hard to answer but easy to verify if the answer is yes.

E.g. is there a path visiting all nodes in this graph of length less than 243000? Hard to answer but easy to check any proposed answer.

Re:GPT-3 is no longer the only game in town by snovv_crash on Sunday November 07, 2021 @02:09PM (#29142454)
It's easy to verify ML training - inference on a test set has lower error than it did before.

Training NN ML is much slower than inference (1000x at least) because it has to calculate all of the gradients.