Re:A Horrible Experiment
by TazeTSchnitzel on Sunday September 20, 2020 @09:52AM
(#24534042)
ML inherits the biases of the data it is trained on. If you want “unbiased” ML models, you must train them on data that is carefully constructed to avoid the biases deemed undesirable.
[ Parent
| on HN ]
I remember I took an introduction class in machine learning when I was a student.
I was surprised how important bias removal was. Preparing the dataset was more than half of the work. And the class was more about statistics than anything else.
It wasn't about racial bias, ethics, or anything like that. More like if you feed too many "5" in your handwriting recognition algorithm, it will will start seeing 5 everywhere.
Re:A Horrible Experiment
by disgruntledphd2 on Sunday September 20, 2020 @11:05AM
(#24534442)
Preparing the dataset is 99.9% of pretty much all ML and data science.
Just like all software engineering is maintenance, all DS is data cleaning.
[dead]
I don’t know “who”. Please tell me. I’m sorry to sound flippant but I mean this sincerely since I’ve never observed any correlation between downvote-used-as-disagree and any particular beliefs.
[dead]