Re:Beyond Gradient Averaging in Parallel Optimization
by fchaubard on Monday December 30, 2024 @08:10PM
(#42555390)
Yes it will allow stable training at much smaller batch sizes. Test it out and let us know if it works for your use case!
[ Parent
| on HN ]
There are no comments on this comment yet.