AI, by contrast, is engineered by humans, so why is it humans can't explain it?
If this was true, the phenomena of feral children would not exist [1]. Human brains are socially engineered by an array of informal (family, friends, social context) and formal (schooling, governments) institutions.
You can show the weights of the connections between the nodes, but that wouldn't really help anybody to understand it.
If I develop an application that can tell if you're gay or not, is it my imperative to report you to the authorities so you can be rounded up and disposed of?
I say you can very well develop such applications if you want to, using them especially against society at large is a privilege afforded to you, and one that can be revoked. Lots of other pseudo-scientific bullshit has been hoisted on the public such as eugenics causing massive amounts of damage, and i'm not looking for the next generation of this that will trend the same way.
You, and me alike exist at the whims of society and when our behaviour displeases enough people you will find yourself imprisoned or worse.
If AI is made explainable, then confidence in AI should more closely map to actual capability (that is, bad AI will not be trusted because its flaws are on display, while good AI will be trusted because its strengths are on display). It will also provide AI developers with a better grasp of what they need to work on.