The importance of initialization and momentum in deep learning [pdf]

Posted by kenarsa on Friday May 17, 2024 @10:03AM
from the cs.toronto.edu dept.

( 1 comment | on HN )

Re:The importance of initialization and momentum in deep lea... by kenarsa on Friday May 17, 2024 @10:03AM (#40390038)

Reflecting on Ilya Sutskever's early contribution to DL. This paper saved my job a decade ago

[ Parent | on HN ]