Re:A Horrible Experiment
by disgruntledphd2 on Sunday September 20, 2020 @11:05AM
(#24534442)
Preparing the dataset is 99.9% of pretty much all ML and data science.
Just like all software engineering is maintenance, all DS is data cleaning.
I was surprised how important bias removal was. Preparing the dataset was more than half of the work. And the class was more about statistics than anything else.
It wasn't about racial bias, ethics, or anything like that. More like if you feed too many "5" in your handwriting recognition algorithm, it will will start seeing 5 everywhere.