Re:DiLoCo: Distributed Low-Communication Training of Languag...
by GaggiX on Wednesday December 06, 2023 @06:19PM
(#38550823)
It's unfortunate that the larger model trained to evaluate the technique is "only" 400M parameters, I'd love to see it applied to models with billions of parameters.
[ Parent
| on HN ]
There are no comments on this comment yet.