News for hackers. Stuff that matters.
Re:GitHub Copilot by hgial on Tuesday June 29, 2021 @09:06PM (#27683775)
At the moment crowd-sourcing ML training doesn't work very well because updates to the model's weights have to be shared between all of the nodes in the computation periodically. Giant models tend to be trained on clusters with very fast interconnects for this reason.

There are no comments on this comment yet.