News for hackers. Stuff that matters.
Re:America is turning against facial-recognition software by diafygi on Friday May 24, 2019 @07:01AM (#20000248)
Just so I have good arguments when talking to someone about this specific point, can you or someone else please go into more detail on why this will happen?
Re:America is turning against facial-recognition software by lazyvoice on Friday May 24, 2019 @07:45AM (#20000506)
For example, let's assume you live in Brunei where homosexuality is a capital crime. Facial-recognition (especially in concert with other pattern-recognition software) drastically reduces the man-power necessary to identify individuals for enforcement.

If you're talking to someone who's more conservatively inclined I'd talk about how Iceland has managed to basically eliminate Down Syndrome. Prenatal pattern recognition has successfully convinced nearly all Icelandic parents who have a pregnancy where the child may have Down Syndrome to abort.

If your listener doesn't care about gay rights AND thinks any fetus with a higher likelihood of having Down Syndrome should be aborted, then they're probably exactly the sort of people working on or hoping to use these tools.

Re:America is turning against facial-recognition software by mnw21cam on Friday May 24, 2019 @09:12AM (#20001064)
Okay, I see your Down Syndrome point, and raise you Autism/Asperger Syndrome. Alright, there isn't currently a test that would enable people with Autism/Asperger Syndrome to be systematically aborted, but it isn't so hard to imagine a future where it would be possible. Given the high proportion of people in this forum with these conditions, how do we feel about this?
Re:America is turning against facial-recognition software by phissk on Friday May 24, 2019 @09:19AM (#20001119)
Please note that you're not aborting 'people' ... just a thing that might become a person.

You're giving (actual) people the opportunity to choose to have healthier families.

- Note that I say 'healthier families' specifically because willfully passing on genetic features that disadvantage your children burdens not just them but your entire family unit.

Re:America is turning against facial-recognition software by danShumway on Friday May 24, 2019 @10:18AM (#20001767)
This still caries an uncomfortable implication that Downs and Autism are inherently negative traits, and that people who have them would be better off not having existed in the first place.

Depending on where you fall on the fetal personhood debate, preventing someone from existing is much better than killing them. But that doesn't mean the choice can't reveal negative things about society's overall attitudes towards people in those groups. If you're a member of one of these groups, it feels bad to have someone tell you that a fundamental part of your personality is something that ought to be eliminated from society in general.

And of course autistic people and their families often have hard lives, but a large portion of that difficulty comes from social and infrastructure problems. We're not good at building societies that are easy for differently abled people to interact with.

I want to make an analogy that should hopefully make the problem more clear. It's easy to make a case that being gay or transgender socially disadvantages both a person and their overall family unit. Raising a transgender child is going to be harder than raising someone that conforms to strict gender-rules -- you're going to have a few difficult conversations, and you're going to fight with a few systems, and you're occasionally going to have to deal with jerks telling you you've messed up your kid. None of this is right or fair, and we're getting a little bit better, but it's still a problem.

If there was a way to detect someone's future sexual orientation and identity in the womb, would you be comfortable allowing families to make abortion decisions based on that information? If that technology had existed in the 1980s where being transgender was even harder than it is today, would you have been comfortable with it being used then? Would gay and transgender rights have made the kind of progress we've seen if that technology had been available and unregulated?

Re:America is turning against facial-recognition software by phissk on Friday May 24, 2019 @12:14PM (#20003016)
Whether it be autism or sexual orientation, it seems even more wrong to choose to have a child with something that will disadvantage them just to bolster the numbers of the other people already in the world being unfairly discriminated against.

Given that in this scenario there are two potential children; the one with undesirable_trait_x, and the replacement without it, and one will come into existence and one will not, as a parent, shouldn't you pick the child that will have the happiest life rather than the one that will better serve as canon-fodder in someones ideological crusade?

Re:America is turning against facial-recognition software by danShumway on Friday May 24, 2019 @02:36PM (#20004152)
Well, from a purely social perspective, the answer is pretty obviously no -- we have a vested interest in increasing social diversity for the same reasons we have a vested interest in increasing genetic diversity. And the ability to widely eliminate qualities that society deems undesirable on a whim will almost definitely lead towards increased homogeneity and worse social outcomes in general for anyone who has a trait that can't be eliminated.

However, I'm guessing you're actually talking about morality on an individual level -- that it's immoral for an individual parent not to try and guarantee their future child the happiest possible life. The problem is that even though being autistic is hard, having a hard life doesn't necessarily mean having a bad life. Being autistic is hard because autistic people are different, not because autism is inherently an undesirable trait.

Not everyone who is autistic or who has Downs would, if given the chance, flip a switch and erase that part of their personality, and they bristle at the "happy life" argument because they see it as (intentionally or not) just another way for people to imply, "differently abled people will always lead less satisfying lives." See also the controversy in the deaf community over hearing aids, which are a much less dicey proposition than eugenics but still prompt heated arguments sometimes.

As a side note, it's worth mentioning that no one is talking about artificially increasing the number of differently abled people as some kind of "recruitment strategy". Opponents to this kind of genetic selection are talking about just removing that characteristic as a determining factor entirely. It's not any different than banning sex-selective abortions, which is already an entirely normal and relatively uncontroversial policy in multiple developed countries.

Re:America is turning against facial-recognition software by mistersquid on Friday May 24, 2019 @09:45AM (#20001361)
The problem lies within the generalizations presented by the words “healthier” and “burdens”.

Many families with Downs children describe how much joy and love their Downs children bring to the family, how the family members learned to cherish what’s important in life, etc.

These families compared to many families with non-Downs children are quite healthy and arguably not burdened though they experience different challenges than other families.

EDIT: fix quote; change last preposition in second sentence.

Re:America is turning against facial-recognition software by lazyvoice on Friday May 24, 2019 @11:55AM (#20002814)
I posted the original example to demonstrate that skepticism IRT abstracting pattern based decision making away from human actors transcends political leanings.

While I personally am not entirely sure how I feel about this sort of eugenics, it's worth noting that at the gestational period these genetic anomalies are detected it's far more likely that these fetuses would progress to develop legal personhood than not.

Given our species history of reliance on anomalous individuals I suspect it's unwise to seek further genetic homogenization and better for us to learn to accept those who don't neatly fit societal norms of fitness.

Re:America is turning against facial-recognition software by donohoe on Friday May 24, 2019 @07:09AM (#20000280)
Not specific to facial recognition but covers it and the deeper issues. It is a thorough yet accessible primer on the many ways bias can creep into these systems:

https://parametric.press/issue-01/the-myth-of-the-impartial-...

Re:America is turning against facial-recognition software by masklinn on Friday May 24, 2019 @07:16AM (#20000325)
As @pinboard noted back in the dark ages of 2016, "machine learning is money laundering for bias".
Re:America is turning against facial-recognition software by paganel on Friday May 24, 2019 @07:13AM (#20000306)
Not the OP by technology like this will explicitly make racial profiling legal again, because the power that be will hide behind the decisions taken by algorithms: “The computer told us to stop and search this black person’s car, it wasn’t us, the computer is smart, we were just following the computer’s orders”.
Re:America is turning against facial-recognition software by chr1 on Friday May 24, 2019 @01:14PM (#20003499)
Re:America is turning against facial-recognition software by bumby on Friday May 24, 2019 @08:41AM (#20000834)
I heard this referred to recently as the "automation fallacy"
Re:America is turning against facial-recognition software by xena on Friday May 24, 2019 @08:48AM (#20000894)
As a transgender woman, this is my fear precisely.
Re:America is turning against facial-recognition software by trevyn on Friday May 24, 2019 @07:16AM (#20000324)
Along the lines of “everyone is breaking some law”, there could be a shift from “technically illegal but generally harmless and tolerated” to “illegal and mindlessly enforced by automated technology”.

An example being China’s automated jaywalking-shamer.

Re:America is turning against facial-recognition software by mc32 on Friday May 24, 2019 @07:57AM (#20000588)
The only “good” outcome of this is we get to know how pervasive surveillance affects behavior and whether the benefits outweigh the detriments. In other words does it result in a better or worse society overall. Even if it’s better overall I’d it worth the negative effects on affected populations?

It’s a living laboratory.

Re:America is turning against facial-recognition software by homonculus1 on Friday May 24, 2019 @08:54AM (#20000930)
The benefits would have to be impossibly valuable to outweigh the constant burden and psychological damage of living in a totalitarian panopticon.

Given that society functions without it and is constantly improving anyway--crime rates, poverty, mortality continue to drop from socioeconomic and technological development without the need for the intervention of pervasive surveillance--I personally literally cannot conceive of a benefit that would actually be worth it.

Re:America is turning against facial-recognition software by mc32 on Friday May 24, 2019 @09:01AM (#20000980)
True, I do not see it turning out well. But it would be a laboratory into behavioral control. Something like this would eliminate needs for safe spaces, anti/hate speech, etc. because this would regulate all this anti social behavior in the first place.
Re:America is turning against facial-recognition software by bryanrasmussen on Friday May 24, 2019 @07:41AM (#20000479)
There have been numerous issues where corpora of peoples faces have been insufficiently stocked with a particular racial group, in such cases people's faces might not register as faces and therefore be shut out of whatever the facial recognition is supposed to implement.

For example facial recognition at a high priced building, suddenly non-white people can't get in because you did not show a real face at the scanner. Sorry, it's a bug not a feature.

The same problem would of course apply to anyone with facial deformities etc.

The problem would be essentially of two forms - Automatic exclusion from a group by facial feature, or automatic inclusion in a group by facial feature.

Think of the automatic inclusion as advanced phrenology or other sort of woo, in this scenario company X sells the idea that they will have facial recognition of 'criminal types' based on whatever research they can pull out that criminals often correspond in appearance. Then they fill that corpus up with criminals which then is a nice self-selecting system of find the black/hispanic person and deny them the job, loan etc. because of likelihood for crime past the threshold set.

the reason why this would happen is the same reason why banks used to deny loans to people in certain zip codes, because by doing so they could be racially profiling and excluding but pretend not to do so.

Re:America is turning against facial-recognition software by mc32 on Friday May 24, 2019 @08:25AM (#20000736)
>”corpora of peoples faces have been insufficiently stocked with a particular racial group, in such cases people's faces might not register as faces..”

I’m not sure this is s good argument against the technology because there is a solution to this objection: they’ll improve it and ensure every face type is comparably recognized. It should be rejected on more basic principles.

Re:America is turning against facial-recognition software by rmrfrmrf on Friday May 24, 2019 @08:47AM (#20000882)
It's not as simple as "just make sure it works on everyone". Even if it were physically possible to capture the face of all 7 billion people on Earth, you'd start running into issues of false positives/negatives, overfitting, etc., and furthermore it would basically require every person to be periodically scanned from birth until death to ensure that the algorithm can recognize new faces.
Re:America is turning against facial-recognition software by mc32 on Friday May 24, 2019 @08:53AM (#20000926)
This is a different objection than the original objection. (effective accuracy vs specific bias).

With a pervasive system, unless people are hermits, they’ll get scanned periodically, and with other bits of information the changed face can be correlated with the same person (I go into a salon looking one way, come out different, go into a boxing match, come out different, but I’m following my routine and go to the same subway stop and convenience store and use the same payment method, etc.)

Re:America is turning against facial-recognition software by xboxnolifes on Friday May 24, 2019 @08:54AM (#20000928)
And then you just have a different implementation of China's social credit surveillance system...
Re:America is turning against facial-recognition software by bryanrasmussen on Friday May 24, 2019 @09:08AM (#20001039)
there are of course examples of technologies that do not work for their stated purpose, but I think in general technologies do work pretty much for their stated purposes if people can use the technology correctly.

Generally the arguments against a technology is not that the technology does not work for its purpose, but that the way humans will use it is problematic.

Re:America is turning against facial-recognition software by povertyworld on Friday May 24, 2019 @08:48AM (#20000897)
The problem with an "it's racist" strawman is that all the people selling this stuff have to do is frame it so NOT using it is racist. I don't think it would be hard to argue that a face scan is going to have less implicit bias than a poorly trained security guard or bored cop working overtime. So maybe it's racist to not use facial recognition, since that leaves room for human prejudice.
Re:America is turning against facial-recognition software by Loughla on Friday May 24, 2019 @10:20AM (#20001792)
How does software not leave room for human prejudice? Who decides what data is used to feed the thing?
Re:America is turning against facial-recognition software by povertyworld on Friday May 24, 2019 @12:08PM (#20002958)
Who decides what face unlocks your iPhone? When you buy a million dollar condo, you decide whose faces you want to unlock it. That way it's not up to some security guard to decide whether to detain your kid in the lobby because he's wearing baggy clothes and didn't style his hair in a way that the guard likes. His face either scans or it doesn't.
Re:America is turning against facial-recognition software by thfuran on Friday May 24, 2019 @11:14AM (#20002369)
My good buddy HAL 9000.
Re:America is turning against facial-recognition software by rmrfrmrf on Friday May 24, 2019 @08:56AM (#20000942)
Many mortgage backing companies still routinely deny loans to black people because their models inversely correlate black homeowners to lower surrounding property values. When a mortgage backer also backs the loans of those same surrounding properties, the risk of losing money on their existing loans increases, thereby leading them to deny the loan and perpetuating racist policy from a so-called "objective" model-driven business decision.
Re:America is turning against facial-recognition software by bumby on Friday May 24, 2019 @08:40AM (#20000824)
Are there organizations that provide validation standards for this type of software?

I'm thinking something analogous to ASME for mechanical systems. Or is the technology still very much in the wild west phase?