News for hackers. Stuff that matters.
Re:Matrix Calculus for Deep Learning by lprd on Tuesday January 30, 2018 @03:33PM (#16268746)
In school, I didn't make it much past basic calculus/algebra. As a self-taught programmer (my highest level of education is a high-school diploma), I seriously wish I could go back and put more effort into math. I love looking at these types of topics, but I have absolutely no clue what I'm looking at.

If anyone can recommend any books, courses, or any other material that starts from high-school level math, and gradually increases in complexity, I would love to look at it.

Cheers :)

Re:Matrix Calculus for Deep Learning by KSS42 on Tuesday January 30, 2018 @05:26PM (#16269661)
I would start by watching the Linear Algebra and Calculus videos by 3Blue1Brown. This will give you an intuitive understanding of both.

https://www.youtube.com/playlist?list=PLZHQObOWTQDPD3MizzM2x...

https://www.youtube.com/playlist?list=PLZHQObOWTQDMsr9K-rj53...

Re:Matrix Calculus for Deep Learning by lprd on Tuesday January 30, 2018 @06:16PM (#16269996)
Thank you!
Re:Matrix Calculus for Deep Learning by j2kun on Tuesday January 30, 2018 @03:36PM (#16268788)
I am writing a book that I hope can serve such a purpose. Would you be interested in taking a look? If so, shoot me an email at [email protected]

Fair warning, I have shown it to a programmer who claimed some level of "math phobia," and they said the first chapter was too difficult. I rewrote that chapter since, and I think it is better, but I could use some feedback :)

Re:Matrix Calculus for Deep Learning by jph00 on Tuesday January 30, 2018 @04:25PM (#16269188)
Well... this paper is really designed to be accessible with just high school math, if you take your time (a few weeks or months) and follow the references. Any time it relies on some concept, it includes a link to learning more about that concept, and also has a link to a forum where you can ask questions if you get stuck. There's also a table of all notation used.

If you give it a go and find you're not successful, I'd be interested to hear where is the first point where you got stuck and couldn't get unstuck, since that would suggest a need for us to improve our paper!

Re:Matrix Calculus for Deep Learning by lprd on Tuesday January 30, 2018 @06:12PM (#16269962)
Hi Jeremy,

I greatly appreciate your response! I will take a long look at this paper again and attempt to digest it.

Thanks again!

Re:Matrix Calculus for Deep Learning by tmbsundar on Wednesday January 31, 2018 @02:56AM (#16272262)
Try "Methods of Mathematics Applied to Calculus, Probability, and Statistics" by Richard Hamming