Re:How AI Training Scales
by taliesinb on Friday December 14, 2018 @03:35PM
(#18684449)
Whats a cheap and unobtrusive way to estimate the BSimple version of the noise scale in real time? Piggy back on ADAM's moving mean and variance estimates? Edit: I see that Appendix A has a method for the multi-device training setting, but I'm thinking of single device training.
[ Parent
| on HN ]
There are no comments on this comment yet.