News for hackers. Stuff that matters.
Re:How AI Training Scales by staticfloat on Friday December 28, 2018 @05:12PM (#18779883)
Yes, we're saying the same thing. It takes longer for the optimizer to converge when using larger batch sizes, in terms of number of samples pushed through the model. It takes less time in terms of wall clock time due to increased efficiency.

There are no comments on this comment yet.