Re:GPT-3 is no longer the only game in town
by rewq4321 on Sunday November 07, 2021 @11:50AM
(#29141057)
The problem is that, currently, large ML models need to be trained on clusters of tightly-connected GPUs/accelerators. So it's kinda useless having a bunch of GPUs spread all over the world with huge latency and low bandwidth between them. That may change though - there are people working on it: https://github.com/learning-at-home/hivemind
[ Parent
| on HN ]
There are no comments on this comment yet.