News for hackers. Stuff that matters.
Re:DiLoCo: Distributed Low-Communication Training of Languag... by GaggiX on Wednesday December 06, 2023 @06:19PM (#38550823)
It's unfortunate that the larger model trained to evaluate the technique is "only" 400M parameters, I'd love to see it applied to models with billions of parameters.

There are no comments on this comment yet.