> These are ultimately surveillance systems that are being marketed to those who have power over us generally: our employers, governments, border control, etc., to make determinations and predictions that will shape our access to resources and opportunities.

And hey, the more arbitrary or even false something is, the more obedience you can demonstrate by going along with it just because computer said no, so that's another "bonus".

Here's a chilling real-life example:

https://www.politico.eu/article/dutch-scandal-serves-as-a-wa...

> In 2019 it was revealed that the Dutch tax authorities had used a self-learning algorithm to create risk profiles in an effort to spot child care benefits fraud.

> Authorities penalized families over a mere suspicion of fraud based on the system’s risk indicators. Tens of thousands of families — often with lower incomes or belonging to ethnic minorities — were pushed into poverty because of exorbitant debts to the tax agency. Some victims committed suicide. More than a thousand children were taken into foster care.

Let that sink in.