We can black box test bureaucracies just as poorly as we can software. For both, all we can do is measure inputs, and outcomes.

Since we've not made much traction on blackbox testing bureaucracies, I'm going to go ahead and say that blackbox testing algorithms will be even worse. (For some dumb reason, people are inclined to trust algorithms.)