Understanding deep learning requires rethinking generalization

Re:Understanding deep learning requires rethinking generaliz... by robbmorganf on Friday March 05, 2021 @08:22AM (#26356556)

> Since NNs are known to be "equivalent" to kernel methods

I remember reading this somewhere, but I can't find the exact paper. Do you think you could link me to it?

Also, I seem to recall the paper didn't provide a method to actually construct the equivalent kernel. Do you know of any work since then that actually constructs an equivalent kernel method?

[ Parent | on HN ]

Re:Understanding deep learning requires rethinking generaliz... by medlyyy on Friday March 05, 2021 @03:34PM (#26361718)

I believe it's this: https://arxiv.org/abs/1711.00165

And then the NTK paper: https://arxiv.org/abs/1806.07572

There is also this which seems to have been produced in parallel, closely related to the first but not exactly the same: https://arxiv.org/abs/1804.11271

[ Parent | on HN ]