Hence the issue of institutional racism in the blackbox AI systems being sold to law enforcement to determine whether to grant parole, for example. There's no review of them, but more importantly the system isn't obligated to explain itself, and no one gets themselves fired because they don't have to explain why they did what the system said to.
You assume someone has malevolent intent: whereas the reality is they just don't care and want a nuisance out of sight and out of mind.
The solution then is accountability to those in power - for negligence. Treat the snake oil salesmen who sell racism in a box like the sociopaths who sold dowsing rod bomb detectors for both have shown a callous disregard for human life in pursuit of profit. This isn't radical - not doing it is radical and messed up.