News for hackers. Stuff that matters.

A comment on Machine Learning: The Great Stagnation. Parent comment

Re:Machine Learning: The Great Stagnation by dkislyuk on Thursday January 14, 2021 @11:23AM (#25778224)
>> CNNs use convolutions which are a generalization of matrix multiplication.

> A nitpick: CNNs are most definitely not a generalization of matrix multiplication. In fact, the opposite: you can view CNNs as a matrix multiplication with a particular matrix structure.

Neither is really a generalization. Any matrix multiplication can be implemented with a convolution function, and yet any convolution can be represented as a matrix multiplication via im2col.

[ Parent | on HN ]
Re:Machine Learning: The Great Stagnation by bnegreve on Thursday January 14, 2021 @12:44PM (#25779450)
Discrete convolutions are a special case of matrix multiplication in the sense that a discrete convolution can be formulated as the product between a Toeplitz matrix and the input signal.

[1] https://en.wikipedia.org/wiki/Toeplitz_matrix#Discrete_convo...

[ Parent | on HN ]