Bureaucracy has usually clear rules, they just follow, where you can go to court, if the rules are not followed.
The rules themself might not make sense and making sense of layers and layers of rules is not an easy task, but you can do it.
But with an blackbox AI trained on proprietary data, you won't know the rules and are blocked from knowing them.
Not sure how that's all that different from good-old bureaucracy?