News for hackers. Stuff that matters.
Re:Demand and Salaries for Data Scientists Continue to Climb by throwaway713 on Saturday January 26, 2019 @06:00PM (#19009133)
Compensation may be going up, but at top tech companies, software engineers still make significantly more than data scientists for the same level (twice the RSUs). I’ve noticed at non-tech companies, the reverse seems to be true: data scientists make slightly more than software engineers.
Re:Demand and Salaries for Data Scientists Continue to Climb by spamizbad on Saturday January 26, 2019 @09:14PM (#19009997)
(Disclaimer: generalization ahead) That might be because they're starting to get hip to the fact that too many data scientists struggle to produce professional-level code, forcing you to pay a software developer to create the actual deliverable from their prototype. At that point, why not just hire a really bright software engineer who can code well and knows how to work with data?
Re:Demand and Salaries for Data Scientists Continue to Climb by walrus1066 on Sunday January 27, 2019 @04:51AM (#19011109)
I'm not sure it's easy for a software engineer to develop a model, it's quite an orthogonal skill, you need a solid grasp on mathematics and especially statistics.
Re:Demand and Salaries for Data Scientists Continue to Climb by amitport on Sunday January 27, 2019 @06:19AM (#19011295)
It's not easy, but there are capable developers that are proficient in data science and it may be cost effective to hire one such (high cost) programmer than one (average cost) data-scientist and another (average cost) programmer.
Re:Demand and Salaries for Data Scientists Continue to Climb by spamizbad on Sunday January 27, 2019 @09:19AM (#19011764)
True, but those software engineers exist, and FAANG and FAANG-adjacent companies offer the work opportunities, prestige and salaries to attract those "twofer" engineers.
Re:Demand and Salaries for Data Scientists Continue to Climb by opportune on Saturday January 26, 2019 @06:23PM (#19009230)
That’s why you become a data engineer and get the best of both worlds. If you can market yourself to a company as a “full stack data developer” you will make more money than either category
Re:Demand and Salaries for Data Scientists Continue to Climb by amznthrowaway2 on Saturday January 26, 2019 @10:20PM (#19010178)
"data engineer" is often considered a lower prestige title than data scientist. "Data scientist" is a title recently thrown around a lot for positions that used to be called "data analyst", with no strong ML or SWE ability required. Amazon's title for scientists with strong ML engineering ability is called "Applied Scientist" and it's paid significantly higher than SWE
Re:Demand and Salaries for Data Scientists Continue to Climb by grogenaut on Saturday January 26, 2019 @11:40PM (#19010366)
You're claiming to know amazon internal except you're also using SWE, not SDE, the standard name for software devs there. Also amazon seems to hire very few Applied Scientists and thus is likely cherry picking for this role. The one I work near is an industry thought leader at Principal Applied Scientist. They'd be a leading researcher if they were in academia.
Re:Demand and Salaries for Data Scientists Continue to Climb by amznthrowaway2 on Sunday January 27, 2019 @07:07AM (#19011402)
Software engineers are given the SDE title at Amazon but I just used SWE as the more general "software engineer" acronym.
Re:Demand and Salaries for Data Scientists Continue to Climb by gaius on Sunday January 27, 2019 @03:25AM (#19010887)
a title recently thrown around a lot for positions that used to be called "data analyst"

Agreed. Maybe this is different in different markets but in London the vast majority of "data scientist" positions advertised are really PowerBI, Excel, etc. If there is any ML it is just to feed data into a black box model. If you were both smart and lucky you might be able to sneak R in by the backdoor and start doing actual data science, but it would be an uphill battle.

Re:Demand and Salaries for Data Scientists Continue to Climb by bitL on Saturday January 26, 2019 @11:08PM (#19010302)
Data Engineer role is about building big data/streaming pipelines for data and often DevOps aspects of keeping such pipeline deployed and online. A boring, dead-end job. Avoid.

Make yourself both ML/DL master and SWEng and you'll be doing extremely well.

Re:Demand and Salaries for Data Scientists Continue to Climb by deepnotderp on Sunday January 27, 2019 @12:08AM (#19010432)
You know that's usually the hard part of ML projects, right? It may be boring, but it also tends to be the less least replaceable component.
Re:Demand and Salaries for Data Scientists Continue to Climb by bitL on Sunday January 27, 2019 @02:25AM (#19010733)
Yes, and there is zero prestige within company, awful lot of high-pressure work, no control over bugs in infrastructure pieces that tend to blow up unexpectedly in production, getting stuck on a certain stack that tends to age badly (who remembers Hadoop or Spark 1.3 these days?), making one quickly replaceable by younger folks with the latest hyped tech, small understanding of the data science part, no joy from constructing great algorithms either. It's a needed job of course; it might pay well at this very moment but it's a perfect target for automation once latest cognitive automation research bubbles down to production.

If you want to shine, do Deep Learning (research if possible), low-level distributed systems you have control of as an author of an important piece of infrastructure or the actual data modeling and predictions.

Re:Demand and Salaries for Data Scientists Continue to Climb by amznthrowaway2 on Sunday January 27, 2019 @07:19AM (#19011425)
He's right about how data pipeline work is regarded by most ML scientists. It often ends up being extremely hard work and is regarded by others as useless grunt work. There is no big reward, constant overtime due to unexpected issues and lots of stress.
Re:Demand and Salaries for Data Scientists Continue to Climb by closeparen on Sunday January 27, 2019 @10:04PM (#19015113)
SQL skills are expected of every data scientist and backend engineer, but are also found in a much larger and cheaper labor pool. As far as I can tell, the data engineering role exists to take advantage of those economics.

ETL pipeline queries and configs are absolutely critical, make or break an ML project, and account for most of its labor hours. But they are the most commoditized part of it.

Re:Demand and Salaries for Data Scientists Continue to Climb by RhodesianHunter on Saturday January 26, 2019 @11:32PM (#19010351)
I do not find my Data Engineer job either boring or dead end, but thanks for the condescension.
Re:Demand and Salaries for Data Scientists Continue to Climb by zaptheimpaler on Saturday January 26, 2019 @11:38PM (#19010361)
I love data engineering - atleast when I practiced it at an adtech company, it involved lots of interesting challenges around performance, distributed systems and a mix of SWE & Ops work. Buut, applying to data engineering jobs I see where the parent poster is coming from (minus the condescension) - a lot of them are about writing simple ETL jobs, and they tend to be lower paid & less prestigious.
Re:Demand and Salaries for Data Scientists Continue to Climb by opportune on Sunday January 27, 2019 @01:35AM (#19010611)
Those certainly exist, but aren’t what I was referring to in my post. The “data engineers” I’ve worked with (and am) are usually distributed systems people who also know a bit of data science. In that case it’s basically a higher “prestige” software engineering role
Re:Demand and Salaries for Data Scientists Continue to Climb by didibus on Saturday January 26, 2019 @07:53PM (#19009645)
My experience at big tech is that software engineers kinda do it all. It's almost DevOpsPmDbaDsDeMle. Where Ds is data scientist, De is data engineer and Mle is machine learning engineer.

And ML scientists are just SE with PhDs in ML.

Basically, they tend to try and not create seperate isolated roles in specialized domains, but instead hire people who can do and figure it all.

The opposite seems true in smaller companies. They break things up, try to hire different roles, specialist in different domains, and segregate each one from one another.

Obviously, mileage may vary, and I'm doing a massive generalisation of big and small businesses, but this is just my observation.

Re:Demand and Salaries for Data Scientists Continue to Climb by minimaxir on Saturday January 26, 2019 @10:15PM (#19010167)
People conflate data scientists, data engineers, and software engineers. Although there is strong overlap between all 3 disciplines, and it benefits to know all 3 disciplines, the day to day responsibilities of all 3 are very different.

Startups try to hire people with double/triple disciplines to reduce costs though.

Re:Demand and Salaries for Data Scientists Continue to Climb by ptd on Saturday January 26, 2019 @06:15PM (#19009196)
How do Machine Learning engineers stack up? Or Data Scientists who work in ML, same outcome?
Re:Demand and Salaries for Data Scientists Continue to Climb by ummonk on Saturday January 26, 2019 @06:31PM (#19009270)
Machine learning engineers (i.e. people with graduate degrees, preferably PhDs) typically outearn both, though when you factor in the work experience that software engineers have accumulated during the time the machine learning people were pursuing the PhD, it's pretty comparable. It's unclear how long this will last now that everyone is pursuing grad degrees in ML/AI.

Data scientists who do ML don't have the same prestige (and pay) as those who have that ML stamp from universities.

Re:Demand and Salaries for Data Scientists Continue to Climb by ACow_Adonis on Saturday January 26, 2019 @07:10PM (#19009447)
Obviously I'm biased in the other direction (and in another country), but this is interesting to me.

I've always taken the ML stamp from universities as a visible sign that you're a newbie, if not purely because those qualifications haven't been around for a sufficiently long time, so its basically a signal when you've got one that you must be just starting out.

Re:Demand and Salaries for Data Scientists Continue to Climb by tmp092 on Saturday January 26, 2019 @09:50PM (#19010104)
Does Google even have a "Data Scientist" title? I don't think I've ever come across a JD for one.
Re:Demand and Salaries for Data Scientists Continue to Climb by higginsc on Saturday January 26, 2019 @10:45PM (#19010249)
Yep, they do. I know several and have been through part of the interview process (I withdrew because Google takes too long, and I went to FB instead of dealing with their bullshit).
Re:Demand and Salaries for Data Scientists Continue to Climb by pbalau on Saturday January 26, 2019 @06:36PM (#19009297)
Not sure if your reply is on topic. Interesting reply, but the original article didn't state data scientists are making more than swes. The article just states that the demand for data peeps and the benefits they get are growing.
Re:Demand and Salaries for Data Scientists Continue to Climb by lsc on Saturday January 26, 2019 @07:38PM (#19009576)
It's relevant to nearly everyone who would be interested in the title of the article, though.
Re:Demand and Salaries for Data Scientists Continue to Climb by pbalau on Saturday January 26, 2019 @07:45PM (#19009600)
how? if profession A gets more demand and pay, does it matter if profession B gets more or less? Is it that damn important if A makes more than B or if B makes more than A?
Re:Demand and Salaries for Data Scientists Continue to Climb by greenhatman on Saturday January 26, 2019 @07:55PM (#19009656)
It's relevant for software engineers who read the title and consider going into data science instead.
Re:Demand and Salaries for Data Scientists Continue to Climb by jriot on Saturday January 26, 2019 @08:44PM (#19009891)
Except most software engineers aren't qualified to go into data science.
Re:Demand and Salaries for Data Scientists Continue to Climb by mkl on Saturday January 26, 2019 @09:35PM (#19010062)
The appropriate knowledge can be acquired if you put in effort. This information is useful for those deciding whether the effort is worth it.
Re:Demand and Salaries for Data Scientists Continue to Climb by jriot on Sunday January 27, 2019 @05:29PM (#19014140)
The appropriate knowledge can be acquired in anything if you put in the effort.
Re:Demand and Salaries for Data Scientists Continue to Climb by bradleyjg on Sunday January 27, 2019 @07:03AM (#19011395)
What exactly are the qualifications? I would have thought a serious, sustained study of statistics--starting with a strong base knowledge of the mathematics of probability and building from there. But based on the resumes I've seen that doesn't seem to be the common opinion.
Re:Demand and Salaries for Data Scientists Continue to Climb by jriot on Sunday January 27, 2019 @05:28PM (#19014139)
I would argue you are correct and those without that knowledge will find themselves in over their head quickly without that knowledge.
Re:Demand and Salaries for Data Scientists Continue to Climb by lsc on Saturday January 26, 2019 @07:52PM (#19009632)
I'm assuming most people who are interested in the title are interested as part of the research one does to decide in what direction they ought to advance their career.

If I'm choosing to train up for job A or job B, I mean, money certainly isn't the only consideration, but it's certainly a very important consideration.

Re:Demand and Salaries for Data Scientists Continue to Climb by thucydidesofusa on Saturday January 26, 2019 @07:53PM (#19009643)
It matters when profession A and profession B are as related as data science / data engineering / software engineering.

I'm not arguing that there's no distinction between the fields, just that people who excel in one can usually do a passable job working in the others. Or rather, you have to have passable skills in the other fields to excel at your chosen field.