News for hackers. Stuff that matters.
Re:Enrollment Is Surging in Machine Learning Classes by cageface on Monday March 14, 2016 @10:13AM (#11282980)
This is fascinating stuff and well worth learning for its own sake but I think people that are jumping on this bandwagon with the idea that there is a bonanza of high paying jobs waiting for them are going to be disappointed. Even very heavily data-centric companies only hire a few ML specialists for every handful of general purpose code monkeys.
Re:Enrollment Is Surging in Machine Learning Classes by ElysianEagle on Monday March 14, 2016 @01:32PM (#11284130)
I think the same thing that happened to quants on Wall Street will happen to those pursuing Data Science/ML today (if it hasn't already happened). Post-2008 there was such a glut of qualified quants that companies moved the goalpost and now it's very difficult to even be considered for a role if you don't have a PhD.

With so many programs and courses springing up about ML, in a few years I suspect there will be a glut of Data Scientists on the market, and once again companies will use the PhD as a filter. Already it seems like a good number of places will only hire PhDs for such roles.

Re:Enrollment Is Surging in Machine Learning Classes by Homunculiheaded on Monday March 14, 2016 @04:22PM (#11285300)
As far as I can tell Wall Street has always had a penchant for pedigree in addition to skills. Large companies are often the same. People used to talk about all software engineers needing CS degrees in the future. Again in Wall Street and large companies you'll see this, but there are still plenty of well paid, talented software developers with no formal CS training.

In my experience hiring and chatting with other people hiring data scientists, there's the same trouble as there is with software engineers. No matter how many people have the training there's still a dearth of applicants that are truly talented and can actually do things. PhDs fleeing academia for a promise of easy employment and money are a huge bulk of new data scientists that I've seen and most of them have a very hard time taking deep knowledge and applying it to solve real-world problems.

At least in tech I think the future of Data Science lies in the perpetually small group of people that will have a proven track record of coming into companies and actually solving problems, just as it has been in software development.

Re:Enrollment Is Surging in Machine Learning Classes by mindcrime on Monday March 14, 2016 @02:15PM (#11284451)
I think the same thing that happened to quants on Wall Street will happen to those pursuing Data Science/ML today (if it hasn't already happened). Post-2008 there was such a glut of qualified quants that companies moved the goalpost and now it's very difficult to even be considered for a role if you don't have a PhD.

I'm not sure that's a valid comparison. There's a relatively fixed and fairly small pool of companies who need quants. Machine Learning, OTOH, can be used by almost any company in existence (even if most of them don't realize it yet). And plenty of companies don't need somebody doing cutting edge academic research in ML... they need somebody who can use a pre-packaged library or service and apply linear regression, or k-means, or build a simple neural network with backprop.

Re:Enrollment Is Surging in Machine Learning Classes by nostrademons on Monday March 14, 2016 @02:43PM (#11284628)
It can't, though. ML works best when you have enough data to build models that are robust and resilient to noise, and enough customers (or users) that these models will move the needle.

The vast majority of startups and small businesses - those whose customer base measures in the dozens to hundreds - should be going out, engaging their customers person-to-person, and looking for qualitative data, because that's what'll move the needle on their sales. There's no point in understanding "your customer base" as a unit until it's big enough that it behaves, statistically, as a unit; instead, you should be focusing on "your customers", individually. Once you get into the thousands of customers you can start applying some basic learning models, and once you get into the millions machine-learning becomes as fundamental as pricing.

But you gotta get there first, and many businesses haven't. And even if they have, userbase-wise, they need to build the infrastructure (through web & mobile devs, backend engineers, data scientists, etc.) to log, store, and clean all that data before they can apply machine-learning to it.

Re:Enrollment Is Surging in Machine Learning Classes by mindcrime on Monday March 14, 2016 @03:08PM (#11284796)
But you gotta get there first, and many businesses haven't.

Agreed. But many have as well. So I'll still argue that there are more potential positions for people doing "applied ML" than there are for quants. I'm open to being proven wrong though.

And even if they have, userbase-wise, they need to build the infrastructure (through web & mobile devs, backend engineers, data scientists, etc.) to log, store, and clean all that data before they can apply machine-learning to it.

We're working on a MLaaS offering to help reduce the need for a lot of that stuff. And there are some offerings in that space already.

Re:Enrollment Is Surging in Machine Learning Classes by sbisker on Monday March 14, 2016 @02:32PM (#11284567)
Once it becomes straightforward to do ML with a pre-packaged library, you'll quickly start to see Amazon or a third-party offer effective MLaaS. That will suck quite a bit of oxygen out of the room.
Re:Enrollment Is Surging in Machine Learning Classes by nostrademons on Monday March 14, 2016 @02:50PM (#11284671)
Already exists:

https://aws.amazon.com/machine-learning/

Problem is, writing an effective machine-learning model already doesn't require knowing the algorithms well. It requires knowing your data well. You can provide tools for this, and AML does, but there's no substitute for actually working with the data day-in-and-day-out and developing an intuition for it.

(Deep learning promises to change that a bit, since the relevant features are extracted for you by the algorithm and you don't need to do any particular data cleaning or feature extraction work. You still need to understand your data well to understand how to train the model, though, and how to apply primitive ML operations - classification, regression, clustering, etc. - to a real-world problem.)

Re:Enrollment Is Surging in Machine Learning Classes by mindcrime on Monday March 14, 2016 @03:10PM (#11284808)
You still need to understand your data well to understand how to train the model, though, and how to apply primitive ML operations - classification, regression, clustering, etc. - to a real-world problem.)

And this is the kind of stuff that I believe can be done by people who don't necessarily need phd's in Stats or ML. A decent grounding in statistics / ML, and good domain knowledge should be enough to support using pre-packaged algorithms to solve business problems.

Re:Enrollment Is Surging in Machine Learning Classes by vram22 on Monday March 14, 2016 @04:15PM (#11285245)
Interesting. I sometimes mentor junior / aspiring devs on a site, and have seen that many of them seem to be trying to get on to the bandwagon you mention; some of them don't even have good experience with basic programming, and are still trying to do machine learning / data science MOOCs, bootcamps or courses on free sites. Some of them seem to be trying to learn programming at the same time as data science / machine learning. Don't think that is going to work out well for them. Many of them seem to in it for the supposed bonanza. Wanting to get a well-paying job is fine in itself, but many of them seem to be trying to shortcut the learning process, either due to ignorance or just because they don't want to spend a lot of time.

Edit: grammar.

Re:Enrollment Is Surging in Machine Learning Classes by vram22 on Tuesday March 15, 2016 @04:55PM (#11292914)
Here's an example I came across on that site, that shows what I mean --- someone put in a request: "I want to build an advanced app and I don't know where to start."

Hey Wow. Hoo Boy (or Girl). Maybe you should start by learning the basics, get some work experience, and only then try to pull a Zark Muckerberg or a Bacefook.

Re:Enrollment Is Surging in Machine Learning Classes by donretag on Monday March 14, 2016 @01:11PM (#11283980)
I have been working in teams with a big ML component for many years, but I have been working from "the outside". I keep on being promised to work more in depth, but never get a chance to. When job hunting last year, I noticed that at almost every company, the division being developers and those working on ML is almost 100%. Both roles are silo'd. Good luck transitioning from dev to ML if you have already started your career. It was not like this just 4 years ago.
Re:Enrollment Is Surging in Machine Learning Classes by myth_drannon on Monday March 14, 2016 @11:24AM (#11283347)
100% true, most of time companies hire PhDs only.
Re:Enrollment Is Surging in Machine Learning Classes by nowey on Monday March 14, 2016 @01:59PM (#11284342)
Ooyala has only 3 data scientists. All have PhDs and come from a math/statistics/com sci background. Kueski only has 1!
Re:Enrollment Is Surging in Machine Learning Classes by pskisf on Monday March 14, 2016 @12:06PM (#11283622)
True from my experience as well. If you're going to invest in a Data Scientist, you want the cachet of having a Phd in that role.
Re:Enrollment Is Surging in Machine Learning Classes by 0xdeadbeefbabe on Monday March 14, 2016 @12:58PM (#11283915)
Not startups.
Re:Enrollment Is Surging in Machine Learning Classes by Futurebot on Monday March 14, 2016 @06:56PM (#11286174)
Where would you go next if that sub-area is already saturated? I'd particularly like to get some opinions for self-taught devs tired of CRUD and DevOps land(s.)
Re:Enrollment Is Surging in Machine Learning Classes by cageface on Monday March 14, 2016 @09:11PM (#11286799)
Good question. I think GOOD crud developers are still in high demand and probably will be for some time. As for myself I've been focusing on getting good at building complex user interfaces. Can't go wrong learning React now.
Re:Enrollment Is Surging in Machine Learning Classes by arvinsim on Tuesday March 15, 2016 @04:28AM (#11288217)
Personally, I think that data visualization would be an interesting niche to go to.
Re:Enrollment Is Surging in Machine Learning Classes by arvinsim on Monday March 14, 2016 @09:03PM (#11286771)
> This is fascinating stuff and well worth learning for its own sake

Touché. As a web developer, I have no illusions on competing with people with the proper mathematical background. However, there are still some problems that are relevant and interesting in our field(collaborative filtering for instance)

So I guess if you temper your expectations, you won't get burned.

Re:Enrollment Is Surging in Machine Learning Classes by kamaal on Wednesday March 16, 2016 @03:06PM (#11299860)
>>Even very heavily data-centric companies only hire a few ML specialists for every handful of general purpose code monkeys.

True for now, but it will change. Once terms like 'Statistics', 'ML' and 'Data science' will become common place, there will be a ridiculous amount of lust for automation jobs.

Sure you won't be fixing the beta release bugs for skynet 1.0. But almost any job which has a scope for data collection, analysis and automation will demand skills in these area.