And I don't think preferring to do stuff yourself is an excuse. These are people's lives on the line! More accurate predictions mean fewer people in prison, fewer murders and robberies, etc. Or in a medical domain where more accurate predictions mean fewer people die of terrible diseases. You should always prefer algorithms if there are consequences for worse predictions!
But the humans would have to explicitly build the biases into the algorithm. Many human biases are unconscious, so we aren't aware that our conclusions are biased by race, a subject's attractiveness, etc. Going with an algorithm would minimize unconscious biases, and prevent us from reaching a conclusion based on emotion and then just back-fitting a rational-sounding argument.
Explicitly as in coding them, but not necessarily as doing it consciously. After all biases are just how people see reality, so it would be natural to code based on one's biases.
Also it's less the biases (that are inevitable), and more the blind following of biases (algorithmically) that I'm concerned about.
>Going with an algorithm would minimize unconscious biases, and prevent us from reaching a conclusion based on emotion
The latter is not necessarily (or even commonly) bad, it's more of a citation needed kind of thing. I'd rather we DO reach conclusions based on emotions. Naked logic sees everything as black and white, it's emotions that make civilisation nuanced (including empathy, pity, gut instinct, abhorrence, etc).
Can you do the same with the human subconscious? Maybe, given lots of time and effort.
How do you evaluate success? Can you do it at scale? I don't think so.
And knives can be used both for murdering people and spreading jam on your bread.
The answer to "racist emotions" are emotions of empathy and love towards the other, and not some objective logic that one can follow to fix racism.
After all, one could always use objective logic to justify racism if one wants to -- e.g. "blacks are involved in a higher percentage of violent crimes compared to their population". That's a totally objective statement, it just skips trying to find the reasons why that might be so, and uses the numbers to justify thinking of them as violent inherently.
Those algorithms are also designed by humans and codify biases and prejudices and injustices that are considered OK by society into them.
Besides, it's like going for a run. Other might might be far better at it, but we want to do it ourselves, even badly, than just be spectators in our own life. Same for humans becoming spectators while algorithms run business "better".
One quality that's not accounted for in accessing better is "more participative".