News for hackers. Stuff that matters.

A comment on Ask HN: What are your biggest pain points as a data scientist?.

Re:Ask HN: What are your biggest pain points as a data scien... by r0f1 on Friday April 12, 2019 @05:21AM (#19643315)
That it is 90% cleaning, and only 10% modeling. Never had a dataset that was ready to use like the ones on Kaggle. Most of the time I get a mixture of Excel Sheets with weird formatting, .csv files and SQL dumps that have questionably encoding, and lots of unnecessary information and missing values.
[ Parent | on HN ]
Re:Ask HN: What are your biggest pain points as a data scien... by apohn on Friday April 12, 2019 @01:45PM (#19647193)
I think Kaggle participants miss out on some of the best parts of being a Data Scientist. Fiddling with data, writing scripts to clean/transform/ingest data, interacting with data owners and subject matter experts, etc. IME that's actually a lot more fun than fiddling with parameters and looking at model performance metrics.
[ Parent | on HN ]