> But the result will be the same for the common people: some black box makes a decision that can ruin your life, if you are unlucky - and with no chance of changing it.

Not sure how that's all that different from good-old bureaucracy?

Bureaucracy has usually clear rules, they just follow, where you can go to court, if the rules are not followed.

The rules themself might not make sense and making sense of layers and layers of rules is not an easy task, but you can do it.

But with an blackbox AI trained on proprietary data, you won't know the rules and are blocked from knowing them.

That's already here and all those machines are easily overruled by those in power.

The "algorithm" is something that the powerful rely on when it's convenient and ignore when it's not.

It's a political battle more than a technical one.

I'd surmise i as Authortiarianism Vs not and the former has made great strides in these last 22 years, but specially the last 3 (as in sept 11 2001 security theater and covid policies hygiene/security theater).

> I mean, we have those HN outcry/support threads since quite a while

What threads, can you elaborate please?

Every few weeks a "Tell HN:" post makes it to the frontpage complaining about [ Google | Stripe | xxx ]'s non-accessible customer service and how some black box systems just banned their account, [ freezing $100k in credit on their account | denying access to 10 years worth of mail | xxx ].

Choose one from the brackets or imagine your own scenario.