News for hackers. Stuff that matters.
Re:Beyond Gradient Averaging in Parallel Optimization by fchaubard on Monday December 30, 2024 @08:10PM (#42555390)
Yes it will allow stable training at much smaller batch sizes. Test it out and let us know if it works for your use case!

There are no comments on this comment yet.