Re:Deep Learning's Diminishing Returns
by albertzeyer on Friday September 24, 2021 @04:56PM
(#28647703)
For modern DL, a large part also comes from regularization. And then also data augmentation. And self-supervision in whatever way, either prediction, masked prediction, contrastive losses, etc.
Which all adds to the number of constraints / equations.
Which all adds to the number of constraints / equations.