Claiming racism is anything but intent is changing the definition of racism. Which is:
"prejudice, discrimination, or antagonism directed against someone of a different race based on the belief that one's own race is superior."
If you start changing the definition of words to suit a political goal, only the people who already agree with you will listen.
As I said, I agree with you. But our position can lead to hiding some genuine racism under the "unintentional" disguise. It also leaves unintentional systematic biases unaddressed. While those may not exist as often as the left claims, they do at least sometimes exist, and do need to be addressed.
If we need to accurately gauge their intent, that's not really possible. In the case of an algorithm we've divorced the process from the source of intent (the author of the algorithm), there is no intent to evaluate.
Claiming that racism can be evaluated only by the intent is simply moving the goal posts into an area where we can't clearly observe. It's a tactic.
In terms of this specific issue, algorithms by their very nature lack intent. Thus this particular argument has no validity; we can only judge the algorithm by it's results: the outcome.