Re:A Bayesian Perspective on Generalization and Stochastic G...
by mlthoughts2018 on Saturday December 08, 2018 @05:03PM
(#18637796)
I suspect actually there is some connection between optimal batch size and the proofs of this paper regarding how deep NN will provably converge to zero training loss with gradient descent (not stochastic gradient descent).
https://arxiv.org/abs/1811.03804