News for hackers. Stuff that matters.
Re:How to Become a Data Scientist, Part 2 by minimaxir on Sunday August 07, 2016 @07:26PM (#12244349)
The best way to learn how to wrangle data is practice, especially outside of academic settings, where the example data is not necessarily reflective of real-world data.

Helping others wrangle data is one of the reasons I publish my Jupyter notebooks open-sourced. A few examples my data wrangling with R:

Processing Stack Overflow Developer data: https://github.com/minimaxir/stack-overflow-survey/blob/mast...

Identifying related Reddit Subreddits: https://github.com/minimaxir/subreddit-related/blob/master/f...

Determining correlation between genders of lead actors of movies on box office revenue: https://github.com/minimaxir/movie-gender/blob/master/movie_...

Re:How to Become a Data Scientist, Part 2 by nl on Sunday August 07, 2016 @09:31PM (#12244906)
This.

I'd add that Kaggle is very good for the "other end" of data science: they generally have pretty clean data, and clear problem descriptions.

In real life the data is never clean and the problems are rarely known in advance.

Re:How to Become a Data Scientist, Part 2 by benhamner on Monday August 08, 2016 @10:57AM (#12248264)
We also are growing https://www.kaggle.com/datasets, which won't necessarily have clean data, clear problem statements, and a well-defined task.
Re:How to Become a Data Scientist, Part 2 by iamjeff on Sunday August 07, 2016 @08:09PM (#12244530)
The "Analysis of Lead Gender and Box Office" project put a smile in my face because it looks like so much fun- that is something that I would like to know how to do in the coming months. Thank you for open sourcing the notebooks and the recommendation to practice then demo on real data.