News for hackers. Stuff that matters.
Re:Desperate for Data Scientists by antt on Wednesday September 05, 2018 @07:16AM (#17916855)
As someone who has been employed in this space recently: No there is not.

There is however a lot of middle managers who have heard the term and want to pay crud vba developer wages for people to make pretty graphs in excel.

The credential inflation is also getting ridiculous. I have an MSc and I don't see how me being able to do quantum chromodynamics at one point in my mid 20s adds value to a business ten years later.

Re:Desperate for Data Scientists by collyw on Wednesday September 05, 2018 @09:31AM (#17917731)
That's what I am thinking. Any half decent software engineer could probably produce the results they need from a few SQL queries. But "data science" is hot at the moment.
Re:Desperate for Data Scientists by i-am-charmander on Wednesday September 05, 2018 @09:59AM (#17918007)
Comments like this reinforce the idea that data science is too broad a term. Everything data-related is thrown into the "data science" bucket.

You describe what I'd call business intelligence or even advanced analytics. SQL jockeys (not a pejorative) really slicing into the data and presenting it in meaningful ways. There's usually exists some science behind these exercises.

Then there's machine learning, which also gets clubbed into the data science camp. Try capturing a convolutional neural network in SQL - you might go bald from pulling your hair out. It's totally not the tool for the job.

While perhaps any half-decent software engineer could maneuver his/her way around the great ML libraries out there to produce a CNN (or something of the like), I would hesitate to give them a project that involves true science (bring out your pitchforks). Experimental design, hypothesis testing, etc. While being a SQL expert could help turnaround time and enable you to test more interesting hypotheses, I wouldn't leave most DBAs to develop and carry out an experiment.

So I guess my point is "data science" is too broad and overused a term to be meaningful.

Re:Desperate for Data Scientists by collyw on Wednesday September 05, 2018 @11:43AM (#17918972)
True, but many people jump on the hype wagons and assume that they need machine learning, or whatever the flavor of the day is when in fact they need something far simpler.
Re:Desperate for Data Scientists by ummonk on Thursday September 06, 2018 @02:08AM (#17924211)
A lot of "machine learning" is the more traditional statistics-based data science, not deep learning using a CNN or something...
Re:Desperate for Data Scientists by i-am-charmander on Thursday September 06, 2018 @08:52AM (#17925840)
I understand that, but my point is good luck doing a lot of that "statistics-based data science" using just SQL.
Re:Desperate for Data Scientists by Kagerjay on Wednesday September 05, 2018 @02:28PM (#17920679)
There's a really good video here, seperating what "data science" means to different companies

https://www.youtube.com/watch?v=xC-c7E5PK0Y

TLDR

- some smaller -mid-sized companies call datascience are actually referring to software engineering / data engineering

- Smaller companies with datascience might be doing software engineering as well, if no data pipelines / collection datasets available (they are using the term wrong here)

- most companies calling for AI/deep learning don't actually meet the requirements for it.

- You don't need a data scientist until you have SWE's / data engineers

- Machine learning is more narrow smaller defined scoped problems / dataset, for things like text classification and analysis. Things like identifying what number is drawn out on a piece of paper using MNIST, etc.

basically, data-science could mean a lot of things and is pretty ambiguous. Its the new software-engineer vs web-developer terminology.

Re:Desperate for Data Scientists by dswalter on Wednesday September 05, 2018 @09:59AM (#17918004)
A half-decent software engineer can easily and quickly produce a lot of data products.

If you divide the responsibilities of a data scientist into two broad categories:

* Can I get the answer I need/build the product I need?

* What is the question I should be answering? What do I need to build?

Software engineers tend to do quite well at the former, but are not necessarily guaranteed to be successful at the latter.

Re:Desperate for Data Scientists by collyw on Wednesday September 05, 2018 @11:44AM (#17918982)
In my experience its the software engineers bosses that are poor at the later.
Re:Desperate for Data Scientists by telchar on Wednesday September 05, 2018 @09:56AM (#17917970)
That really depends. I'm working sometimes on problems that physician researchers have been cranking away on for decades. We want to do better than their state of the art. That's not something you can throw a software engineer at. There is a pretty wide spread of problem difficulty out there.
Re:Desperate for Data Scientists by sizzle on Thursday September 06, 2018 @01:05AM (#17923996)
Is a masters enough nowadays for the good data science gigs (autonomy) or is a PhD going to command these gigs?
Re:Desperate for Data Scientists by throwaway5250 on Wednesday September 05, 2018 @07:43PM (#17922807)
Concur. On a job hunt this year, my several years of DS drew no bites, while my skills in other niches did fine.