Re:Matrix Calculus for Deep Learning
by fg6hr on Friday November 29, 2019 @07:04PM
(#21667562)
My guess is that what I'm asking for isn't that complex and could be done by a few serious mathematicians in a few years. The dynamics of tanh(Ax+b) is hardly more complex than Naiver-Stokes equation or the modern topology theory.
[ Parent
| on HN ]
Re:Matrix Calculus for Deep Learning
by improbable22 on Saturday November 30, 2019 @09:52AM
(#21670198)
tanh(Ax+b) is simple, but the dataset it's supposed to work on is not easily summarised. I think that's the huge difference. The guys doing "sugar molecule" studies make progress by taking much simpler datasets, like random points.
Naiver-Stokes is much simpler because it operates by itself. Of course turbulence is hard but even there we usually care about its coarse features, we'd be content to throw away almost all the information provided the calculation of the wing's lift works out OK.