News for hackers. Stuff that matters.
Re:DiLoCo: Distributed Low-Communication Training of Languag... by gaogao on Wednesday December 06, 2023 @06:07PM (#38550728)
The limitations of the paper is more so maximum number of workers than minimum. It'd be pretty neat to get something that could work across 100+ distributed workers well.

There are no comments on this comment yet.