Re:Interpretability in Machine Learning: An Overview
by snovv_crash on Thursday December 03, 2020 @07:18AM
(#25288136)
It's more than discrimination in banking, you need to show that there are no side channels where insider information might be fed in.
Re:Interpretability in Machine Learning: An Overview
by disgruntledphd2 on Monday November 30, 2020 @09:14AM
(#25253882)
This comment is very, very true.
While you as a person may not be able to get details of the algorithms and methods used, the regulators get exhaustive documentation about every aspect of them.
With GDPR, explainability is going to become a requirement, but it will probably take some test cases before this happens.
For good reasons, guardrails are required to not only protect against discrimination, but also so proxies can't be used either. For example, we can't include race in health and life underwriting decisions. But since zip code is highly predictive of race, that attribute must also be excluded.
I'm not familiar with banking regulations, but imagine similar policies are applied. In these cases, being able to demonstrate that a model isn't discriminating is not only ethically important, but in many cases is legally required.