Re:A New Lens on Understanding Generalization in Deep Learning
by sgt101 on Sunday March 21, 2021 @05:04AM
(#26529120)
Resnet works better than MLP not because it optimizes faster, but because the architecture of the network contains a bias towards spatially structured data. MLP's see images as sorted or scrambled, the relationship of each pixel to another pixel is the same at the start (or randomly stronger or weaker if you initialize the network randomly).
[ Parent
| on HN ]
There are no comments on this comment yet.