News for hackers. Stuff that matters.

A comment on Data Science: Reality Doesn't Meet Expectations. Parent comment

Re:Data Science: Reality Doesn't Meet Expectations by avs733 on Tuesday April 07, 2020 @10:03PM (#22809414)
>This. Universities and online challenges provide clean labeled data, and score on model performance.

First homework assignment in the stats class I teach is to clean data that the class generated with directions they all perceived as clear. It's near about the most hated assignment I have ever given. Amazing how many ways there are to encode gender of a experimental participant.

Male, M, m, male, Man, ...

[ Parent | on HN ]
Re:Data Science: Reality Doesn't Meet Expectations by plants on Wednesday April 08, 2020 @10:30AM (#22813251)
gender.lower().startswith('m')... done! :)
[ Parent | on HN ]
Re:Data Science: Reality Doesn't Meet Expectations by bart_spoon on Wednesday April 08, 2020 @11:03AM (#22813558)
Except a real dataset will have its fair share of "nale", "amle", etc.
[ Parent | on HN ]
Re:Data Science: Reality Doesn't Meet Expectations by avs733 on Thursday April 09, 2020 @12:16AM (#22819718)
I would pay student who figured that out $20
[ Parent | on HN ]