Re:Computing Higher Order Derivatives of Matrix and Tensor E...
by aabajian on Friday November 16, 2018 @01:19AM
(#18466871)
This is a fascinating paper. It demonstrates how rooted deep learning is in classical mathematics, and how libraries like TensorFlow/Keras/PyTorch/etc. have both helped and hurt its progress. A software developer can build and train a neural network in under an hour with these libraries, with little knowledge of the underlying math. We take for granted that the implementation is optimized. Imagine if the built-in Python sorted function took O(n^3) instead of O(n log n). It wouldn't take long for someone to point out a better approach. There's a huge need for people who excel at math and can program and have time to do open-source.
[ Parent
| on HN ]
There are no comments on this comment yet.