News for hackers. Stuff that matters.
Re:Accuracy dominates bias and self-fulfilling prophecy [pdf] by AstralStorm on Friday December 15, 2017 @03:23AM (#15930402)
The trouble is there is no individuating information at the first meeting. This makes the hiring (like most hiring) subject to prejudice. Which may or may not be justified or accurate. What was measured was difference in hiring rather than performance.

Unsurprising at all. The cure is either blind auditions or extended trial periods. Or impartially designed tests.

Tricky question is who is supposed to bear the cost.

That is if they problem really is of big magnitude and worth solving in the specific case. Which is done by measuring the magnitude and outcomes rather than detecting presence of prejudice. Then investigating the causes by hard analysis rather than politically biased guesswork.

Re:Accuracy dominates bias and self-fulfilling prophecy [pdf] by virgilp on Friday December 15, 2017 @05:13AM (#15930815)
It's worse than that. You don't just need the information - you need a prevalence of individuating information as well as lack of other (non-relevant/ distracting) information. The panel at the blind audition does not give you any new information - it just removes some of it, and that seems to be enough to break bias.

Making lots of money out of stock trading is rather easy in the presence of clear and relevant individuating information about all entities that are being traded. So is any decision making. That does not mean that in real life, "decision making" or "stock trading" are simple problems that we shouldn't be concerned with.

Re:Accuracy dominates bias and self-fulfilling prophecy [pdf] by AstralStorm on Friday December 15, 2017 @08:36AM (#15931669)
Yes, we should be concerned, especially as the outcomes other than differences have not been tested in that specific study. In other words, whether the prejudice was accurate or not and harmful ( to the goal of having a better orchestra) or not.

The irony is that there is strong prejudice that every prejudice and bias is harmful and in a major way. This actually remains to be seen.

To follow from your example, investors in many index funds do not have access to individuating information yet are making profits. Which means their perception of the market is at least somewhat accurate. But some investors who do have access to special information (and are not caught as doing insider trading) cash out much bigger. Often they do no better or worse too. You get too actually evaluate outcomes of each investment (or hiring) system.