Re:A brief history and future of credit scores
by harryh on Sunday July 14, 2019 @07:33PM
(#20436964)
That is a fine answer to mieseratte's question but I feel compelled to mention that the propublica article you link to is...pretty bad.
Here's a pretty good summary of why:
https://www.chrisstucchio.com/blog/2016/propublica_is_lying....
Edit: It’s unclear if this system is based on ML, but I think the point stands - if a system can be manually tuned to do this, the risk exists of this happening to a trained model as well. Given other cases of ML models learning an incorrect behavior (such as the system intended to detect skin cancer that ended up being a fancy ruler detector [2]).
[1]: https://www.propublica.org/article/machine-bias-risk-assessm... [2]: https://www.thedailybeast.com/why-doctors-arent-afraid-of-be...