Re:Understanding Convolution in Deep Learning (2015)
by Der_Einzige on Tuesday September 08, 2020 @12:10PM
(#24409783)
You didn't explain why its faster though.
It's faster because its reduces the dimensionality of the inputs down to something manageable (hundreds or low thousands). You can replace convolutions with most other types of dimensionality reduction (including other types of layers) and outside of image tasks you'll get very similar or even better performance.
Re:Understanding Convolution in Deep Learning (2015)
by elcritch on Tuesday September 08, 2020 @08:15PM
(#24415206)
I wonder if that’d work by doing a 2d Fourier transformer on an image before hand, but you’re not reducing dimensionally that way.
Re:Understanding Convolution in Deep Learning (2015)
by bonoboTP on Tuesday September 08, 2020 @08:59PM
(#24415514)
Convolution has been an established term in image processing long before convnets were invented in the 90s (or 80s or whenever). It's the same thing. It's useful to learn a bit of basic image processing, edge detection etc before jumping straight into the flashiest shiniest DL model with no basic foundations to conceptualize what is happening.
(Even before that it has been used in signal processing.)
The idea behind convolution in deep learning is that, if a particular pattern of pixels is meaningful, then it is probably also meaningful if you shift the whole thing in some direction. So you can force some layers of the network to be the same under translation, and it'll be faster to pick up some sorts of patterns.