Additionally, we're seeing the introduction of even more sophisticated stochastic samplers (stochastic gradient hamiltonian monte-carlo, etc) that require even more esoteric branches of math and physics to really grok. I have a strong math background but frequently find myself struggling with a lack of knowledge in statistical mechanics when trying to read papers in these areas.
So yeah - there's plenty of bullshit and exaggeration. But there's also some wicked cool stuff happening which requires very sophisticated (and specialized) knowledge to understand.
I've been working in golang, which fortunately has built-in complex128 types, so it's proved very helpful in a project!
I took a complex analysis class and did OK, but I get the feeling that EEs are the ones who really benefit from it (at least in the applied world). They seem to have some very rich analyses of linear dynamical systems using frequency domain methods.
I believe the above was used in sk-learn or PyMC3 at some point.
Like I said, the list was a bit too theory focused and not just for ML. Hope that clears things up.
Also, maybe a bit out of place, but it makes my day happier when I assume good intentions out of random tidbits posted online.
If you have a background in physics then some combination of Nakahara's 'Geometry, Topology and Physics' and Baez and Muniain's 'Gauge Fields, Knots and Gravity' might be good (I haven't included relativity textbooks as I assume it you have a background in GR then you have enough differential geometry).
An unusual recommendation that I think is really nice is 'Stochastic Models, Information Theory and Lie Groups' by Chirikjian. It covers a few other topics mentioned in this thread and is really nice. It's _extremely_ concrete and spells out a lot of calculations in great detail. Plus, the connection to engineering applications is much more obvious.
Hartle, James B., Gravity: An Introduction to Einstein's General
Schutz, Bernard, A First Course in General Relativity
The first few chapters would be all you need, but they don't include the nice things I learned from the lecture notes like how to derive the gradient, divergence, and curl in any curvilinear coordinate system by using the Christoffel symbols.
Sorry that I can't be of much more help.
Learn some:
Calc up to 3 (you can skip some of the divergence and curl stuff)
Linear algebra (no need for Jordan change of basis)
Real analysis
Intermediate probability theory (MAE, MAP, conjugate priors minus the measure theory stuff)
A little bit of differential geometry (at least geodesics. This is for dimension reduction)
Discrete math (know counting and sums really well)
Learn a little bit of Physics (at least know Lagrangians and Hamiltonians)
A little bit of complex analysis (to know contour integration and fourier/laplace transforms)
Some differential equations (up to Frobenius and wave equations)
Some graph theory (my weak spot, but I have used the matrix representations a few times)
After all that, read some Kevin Murphy and Peter Norvig.
Congrats, now you can read most machine learning papers. The above will also give you the toolkit to learn things as they come up like Robbins-Monro.
OP's article is much better if you are trying to be a ML developer/practitioner. Like I said, this list might be too theory focused, but it lets me read lots of applied math papers that aren't ML focused.