News for hackers. Stuff that matters.
Re:L2 Regularization and Batch Norm by samgd on Tuesday July 23, 2019 @09:01AM (#20506359)
Myrtle has a similar series that includes discussion about batch normalisation: https://myrtle.ai/learn/how-to-train-your-resnet/

https://twitter.com/dcpage3/status/1141700299071066112

Disclaimer: I work at Myrtle!

Re:L2 Regularization and Batch Norm by stared on Tuesday July 23, 2019 @12:42PM (#20508089)
I looked at it, and it is very good: good baselines, explanations, visualizations and going deeper than a typical "it is a black box but if you copy & paste it will work".

I was surprised by the nice network vis (and I did dive into the subject before: https://medium.com/inbrowserai/simple-diagrams-of-convoluted...). The only thing that looks clunky is the text logs for training (a shameless plug: https://github.com/stared/livelossplot).