News for hackers. Stuff that matters.
Re:A brief history and future of credit scores by Arcsech on Sunday July 14, 2019 @07:28PM (#20436945)
Yes, for one example, a system used to recommend sentencing based on how likely a criminal was to re-offend was found to have been heavily biased based on race, despite not being given explicit information about race[1].

Edit: It’s unclear if this system is based on ML, but I think the point stands - if a system can be manually tuned to do this, the risk exists of this happening to a trained model as well. Given other cases of ML models learning an incorrect behavior (such as the system intended to detect skin cancer that ended up being a fancy ruler detector [2]).

[1]: https://www.propublica.org/article/machine-bias-risk-assessm... [2]: https://www.thedailybeast.com/why-doctors-arent-afraid-of-be...

Re:A brief history and future of credit scores by harryh on Sunday July 14, 2019 @07:33PM (#20436964)
That is a fine answer to mieseratte's question but I feel compelled to mention that the propublica article you link to is...pretty bad.

Here's a pretty good summary of why:

https://www.chrisstucchio.com/blog/2016/propublica_is_lying....