> You can have ex-post narratives for what humans did, but that is not the same as an actual explanation. Actual human cognition is a black box as of now. The issue of appeals processes is totally separate.

Demagoguery.

Already right now you have police accusing innocent people because some ML system told them so, and China running the world' largest social credit system based on nothing.

> For some high risk things like controlling certain complex machinery or processes AI might indeed be needed because control is beyond human understanding.

Ash. I should've been more clear. That's not the high-risk systems the EU AI Act talks about. I will not re-type everything, but this article has a good overview: https://softwarecrisis.dev/letters/the-truth-about-the-eu-ac...