News for hackers. Stuff that matters.
Re:How to Become a Data Scientist, Part 2 by darkhorn on Sunday August 07, 2016 @05:41PM (#12243816)
BS in Statistics? If you don't have one you are very likely not a data SCIENTIST. You will be data guy.

I know that some meteorologist have used normality in forcasting. This is an example of why you cannot become a data SCIENTIST. Another example; applying regression to your data. If you think that regression is as simple as its formula then you need at least 4 years to understand what I mean.

Re:How to Become a Data Scientist, Part 2 by ibab on Sunday August 07, 2016 @06:05PM (#12243946)
Why should not having a BS in statistics prevent anyone from properly learning and applying statistics in a rigorous scientific fashion?

There are a lot of people with a rigorous mathematical background (mathematicians, physicists, biologists, computer scientists, ...) who are perfectly capable of understanding and applying stats concepts at a high level. In addition, these people have a lot of experience with doing scientific research, so shouldn't they be even more qualified to call themselves "data scientists"?

Can you give an example of something that clearly distinguishes a "data scientist" from say a physicist who learned regression from a stats textbook?

Re:How to Become a Data Scientist, Part 2 by markovbling on Sunday August 07, 2016 @07:25PM (#12244345)
there are a lot of gotchas that don't seem like errors but completely invalidate analysis when done without a thorough understanding of a technique.

For example you can learn regression from a stats textbook but unless you've gone through a thorough (and painful) graduate-level stats course, you probably haven't seen the edge cases that invalidate assumptions and necessitate a more complex regression e.g. your regression may suggest there is no effect but when you look at the residuals, you may find systematic bias that you can model using a subject-specific random effect or some transformation as a generalized linear model...

That isn't to say you need a graduate level stats degree but applying statistics without understanding the pitfalls can lead to seriously wrong conclusions.

Re:How to Become a Data Scientist, Part 2 by ibab on Sunday August 07, 2016 @08:30PM (#12244622)
That's a good point, but I suspect that a lot of serious gotchas that a data scientist might encounter in the wild are not taught as part of a graduate-level statistics course. Being able to think critically and quickly adapting to the problem at hand might end up being more important than previous experience in stats (which is still very valuable, of course).
Re:How to Become a Data Scientist, Part 2 by taeric on Sunday August 07, 2016 @06:19PM (#12244016)
Does the word scientist mean something different if it is in all caps?

I mean, I get it. You would like it for the word to remain some pure version of meaning that it actually never had. Similar to getting upset that people using the word literally in a very figurative sense.

The relevant question on this style of article is not about word smithing.

That said, I'm in a field where we often through the title engineer on people, but we don't know why.

Re:How to Become a Data Scientist, Part 2 by Obi_Juan_Kenobi on Monday August 08, 2016 @12:38AM (#12245537)
I don't really want to weigh in on a semantic argument, but I was considering what would be a good definition for a 'scientist' vocation.

To me, a scientist is someone who engages in research with generalizable results.

That would exclude someone who does experiments and analysis, but only applies established methods to a particular problem. Call them an analyst, perhaps, but science is an ongoing dialog that they are not participating in.

I think that's part of why many consider it really presumptuous for 'data scientists' to call themselves such. Some of them are certainly developing new methods and engaging in a kind of dialog that is definitely science. Others are addressing business needs with a new sort of analysis, drawing on the field but not giving back to it. There is absolutely nothing wrong with that, but it does seem like that pursuit is different enough to bother calling it something else.

Re:How to Become a Data Scientist, Part 2 by taeric on Monday August 08, 2016 @11:27AM (#12248508)
Historically, I think this would exclude a lot of well known scientists. Consider, many of them were running experiments to find an answer. Could have been aiming cannon balls or planting crops. Or, in the case of many of them, looking for a way to transmute matter. :)

More recently, a lot of scientists worked to figure out atomic energy. Most, in likelihood, we do not know the names of anymore.

I think of it as musicians. If you define musician to be rockstar, there are not nearly as many as if you include school teachers, symphony players, conductors, etc. Yet, for most people, this later set would definitely be considered a musician.

Re:How to Become a Data Scientist, Part 2 by WhitneyLand on Sunday August 07, 2016 @08:03PM (#12244500)
Get your point, but actually "literally" did actually used to have a different meaning. Only recently have dictionaries accepted the nonliteral use as a form of emphasis. In fact Cambridge still disallows it for formal speech.
Re:How to Become a Data Scientist, Part 2 by taeric on Sunday August 07, 2016 @08:27PM (#12244611)
Define recently. :) http://www.merriam-webster.com/words-at-play/misuse-of-liter...

Now... I deserve to be literally roasted for some of the other mistakes above. I should know throw versus through... Not even pronounced the same...

Re:How to Become a Data Scientist, Part 2 by Fiahil on Sunday August 07, 2016 @07:03PM (#12244234)
Saying you can't be a data scientist without a Bachelor degree in statistics is like saying you can't be a software engineer without a Master's degree in software engineering. Your educational system is not really a good environment for learning, so I'm pretty sure someone can become a data scientist with a French "License d'Histoire Moderne" and a lot of work.
Re:How to Become a Data Scientist, Part 2 by darkhorn on Monday August 08, 2016 @03:53AM (#12246113)
Oh yeah, there was a miss calculation of a financial information and I guess because of this stocks have fell. Why? Because some smart guys used Excel.

Or, then I can become a doctor right? By studying hard at home?

You should not employ a self thought software engineer or statistician or a doctor in critical positions such as health, finance, engineering, and science. Some might be okay but 99.9% of them will be incompetent for the work.

Re:How to Become a Data Scientist, Part 2 by tomrod on Sunday August 07, 2016 @06:23PM (#12244049)
I appreciate that you hedged by saying "are very likely not" instead of just saying "not".

See, here's the deal. Numerical literacy (numeracy) comes about through many processes, one of which is obtaining a statistics degree.

However, not many fresh statisticians could tell you or me the expected runtime of a taking a numerical field's median on a large database. Why? Because the backgrounds are different. Yet, for a solid data science team, you'd like at least someone who can give insight as to whether your project will take minutes or decades to complete. This (contrived but important) example suggests that while a BS in statistics is an important and necessary component of a data science team, it not sufficient.

Re:How to Become a Data Scientist, Part 2 by moseandre on Sunday August 07, 2016 @07:14PM (#12244287)
It was a statistics class where I learned a linear time median algorithm. But that was pretty lucky, I admit.

95% of undergraduate statistics education is focused on formal inference. Data science, in my experience, involves a lot more exploratory data analysis [1] than formal inference (frequentist or Bayesian).

The extreme focus on inference and the hypothesis testing step in the scientific method is something people with a formal statistics education have to overcome to be productive data scientists. Or applied statisticians, really! It is more important to understand the data, organize it creatively, and find unexpected structure.

[1] https://en.wikipedia.org/wiki/Exploratory_data_analysis

Re:How to Become a Data Scientist, Part 2 by MichaelGG on Sunday August 07, 2016 @07:22PM (#12244330)
Being a scientist is a mindset and someone that follows a certain approach.

Existing institutions do not have a monopoly on who is a scientist.