News for hackers. Stuff that matters.
Re:Microsoft releases CNTK, its open source deep learning to... by mjw on Monday January 25, 2016 @01:53PM (#10969057)
Yep. To elaborate: really big batch sizes can speed up training data throughput, but usually mean that less is learned from each example seen, so time-to-convergence might not necessarily improve (might even increase, if you take things too far).

Training data throughput isn't the right metric to compare -- look at time to convergence, or e.g. time to some target accuracy level on held-out data.

There are no comments on this comment yet.