News for hackers. Stuff that matters.

A comment on Findings from the Imagenet and CIFAR10 competitions. Parent comment

Re:Findings from the Imagenet and CIFAR10 competitions by karandwivedi42 on Thursday May 03, 2018 @01:11AM (#16983503)
How important was momentum cycle (The decrease then increase)?

Unrelated but it would be great if you could answer: In general, how important is momentum tuning and what are the heuristics for the same?

[ Parent | on HN ]
Re:Findings from the Imagenet and CIFAR10 competitions by jph00 on Thursday May 03, 2018 @01:28PM (#16987898)
Based on Smith's paper and our experiments, it seems pretty important. But there's still much research to be done to understand momentum tuning and related concepts.
[ Parent | on HN ]