News for hackers. Stuff that matters.
Re:The Modern Mathematics of Deep Learning by rohittidke on Saturday June 12, 2021 @05:33PM (#27487597)
I believe that the curse of dimensionility doesn't apply here as we are optimizing the "universal apppriximator" of the "surface" of the possible real world function.
Re:The Modern Mathematics of Deep Learning by ganzuul on Saturday June 12, 2021 @07:18PM (#27488271)
> Kernel methods owe their name to the use of kernel functions, which enable them to operate in a high-dimensional, implicit feature space without ever computing the coordinates of the data in that space, but rather by simply computing the inner products between the images of all pairs of data in the feature space. - https://en.wikipedia.org/wiki/Kernel_method

As it relates to this: https://en.wikipedia.org/wiki/Neural_tangent_kernel

To me, this is JFM. Not sure if I'm connecting the dots right either. I just don't know of anything else claiming to solve the curse.

Re:The Modern Mathematics of Deep Learning by antipaul on Saturday June 12, 2021 @05:35PM (#27487606)
Does “possible” in your statement refer to the inherent constraints of the architecture as specified by the researcher, or something else?