Re:DiLoCo: Distributed Low-Communication Training of Languag...
by gaogao on Wednesday December 06, 2023 @06:07PM
(#38550728)
The limitations of the paper is more so maximum number of workers than minimum. It'd be pretty neat to get something that could work across 100+ distributed workers well.
[ Parent
| on HN ]
There are no comments on this comment yet.