News for hackers. Stuff that matters.
Re:Machine Learning Exercises in Python, Part 1 by CloudYeller on Saturday August 13, 2016 @02:53AM (#12280558)
Spot on. I respect the depth of Ng's knowledge, but for 99% of people, knowing how to implement a linear regression algorithm is completely useless. Hardly anyone is trying to write a better ML algorithm; the rest of us just need to import code that was written by PhD's. So it's far better to understand higher level concepts like when you should use a certain ML method, what assumptions go into it, and generally how the underlying algorithms work.
Re:Machine Learning Exercises in Python, Part 1 by RockyMcNuts on Saturday August 13, 2016 @10:19AM (#12281588)
Well, not if you want to be a data scientist, I think.

If you don't do a class where you build things from first principles, you'll never know how to tweak code you imported.

The linear regression algorithm he teaches is a stepping stone to neural networks, it's a neural network with no hidden layer and no nonlinearity. True, you would probably never use that in the field but you have to start with something simple.

After I took the Ng course and put a couple of algos built from examples in the course into production, I said, "oh, let me use R or scikit-learn instead of this hacky Octave." And off the shelf using default parameters, none of them performed nearly as well. You need to understand the algorithm pretty granularly to be able to then cross-validate and tune parameters.

The field is sufficiently new that for anything interesting, an off-the-shelf import from scikit-learn is not going to be anywhere near state of the art, you should have the ability to roll your own.

It would be interesting to re-implement Ng's examples and assignments in TensorFlow.

Re:Machine Learning Exercises in Python, Part 1 by shostack on Saturday August 13, 2016 @01:44PM (#12282307)
For people getting started with ML do you think it is more important to learn first principles and the "boring" math like this, or do you think it is important to give the learner some quick wins and keep the excitement and interest levels up?
Re:Machine Learning Exercises in Python, Part 1 by RockyMcNuts on Saturday August 13, 2016 @03:23PM (#12282706)
Do what feels good for you :)

Ng is a fine place to start, you get some pretty quick wins, doing MNIST from first principles within a month or two. You just need to know or get comfortable with matrix multiplication. It strikes a reasonable balance between being rigorous and approachable for a committed student at an undergrad level.

Principles of Statistical Learning is easier https://lagunita.stanford.edu/courses/HumanitiesandScience/S...

LAFF linear algebra is just starting http://www.ulaff.net/

Hinton's Neural Networks is offered in the fall https://www.coursera.org/learn/neural-networks

For my money, I wouldn't do something like Practical Machine Learning in R, because I think you'll learn more R than machine learning. I wouldn't do the Udacity TensorFlow course because I think it assumes a lot of stuff you would learn in Ng's class ... I think Ng is a fine place to start.

Re:Machine Learning Exercises in Python, Part 1 by closed on Saturday August 13, 2016 @02:40PM (#12282540)
This feels like a pretty loaded question. It seems like you can have math with quick wins, keeping excitement and interest. When you say "boring" math, are you referring to the overall content or the way it's taught?

Most of my experiences with "boring" math was because it felt taught poorly or I wasn't ready for it.

ML is such a broad canopy that it probably includes many who aren't ready for the math, and will find it boring. It's the same with the distinction between appliers and "methodologists" in statistics.

Breaking down "people getting started with ML" into what they want to do with it feels more tractable. Maybe it's an issue of courses signaling who they are geared for.

Re:Machine Learning Exercises in Python, Part 1 by Joof on Saturday August 13, 2016 @04:03AM (#12280695)
I'm really glad it's out there though. I may be in the minority, but I would love to write better ML algorithms!
Re:Machine Learning Exercises in Python, Part 1 by jim-greer on Monday August 15, 2016 @03:49PM (#12292913)
Can you recommend courses/books/etc that take that approach?