News for hackers. Stuff that matters.
Re:‘Simple’ AI can anticipate bank managers’ loan decisions ... by richardfey on Saturday February 19, 2022 @03:04AM (#30395264)
If you want to impress me, tell me also the results of these:

- Performance against a fair dice - Performance against a group of humans trained to predict bank managers' loan decisions

Re:‘Simple’ AI can anticipate bank managers’ loan decisions ... by DrRavenstein on Saturday February 19, 2022 @03:22AM (#30395358)
The article is a bit rubbish. They're not predicting on the binary "would we give these people a loan or not" but they're predicting manual corrections fo credit scores by bank managers. It's a 15 way classification problem (1 is low score, 15 is high). The data is distributed in a bell-curve like way with the most people in the 6 or 7 bracket.

From the paper:

> As is typical in machine learning we also report the Accuracy p-value computed from a one-sided test (Kuhn et al., 2008) which compares the prediction accuracy to the "no information rate", which is the largest class percentage in the data (23.85%).

So fair dice 23.85%, model 95%.

That said I bet a human who had read the banking rules and regulations and recommendations on lending could easily match this performance.

Re:‘Simple’ AI can anticipate bank managers’ loan decisions ... by blitzar on Sunday February 20, 2022 @05:13AM (#30404638)
Performance against a group of humans not trained to predict bank managers' loan decisions, might come in pretty close as well.
Re:‘Simple’ AI can anticipate bank managers’ loan decisions ... by jdrc on Saturday February 19, 2022 @03:06AM (#30395273)
i d be more interested if the ai made a better financial decision than the managers