[0] https://medium.com/ml-everything/how-facial-recognition-work...
> However, just from a cursory review of the mugshots, people of color were disproportionately represented in the mugshot database. So it’s not entirely fair to criticize the facial recognition technology for matching more people of color.
No, the point is the disproportionate representation, and it is a fair criticism, because it is a fundamental limiting factor in the use of the technology. You seem to be distinguishing the "technology" from the data source, but that is not possible. The quality of the technology depends on the quality of the data provided to it.
> I believe a curated list of mugshots with certain characteristics would result in a similar representation of mismatches. Nothing I have read about the technology suggests that there are inherit [sic, is inherent] bias.
This bias is in the data, not the algorithm per se. This is quite accepted in many, even most, criticisms of machine learning applications in the social sphere. It comes up a lot for example in NLP models, for example with assumptions on gender for professions.
It is a technology problem because it demands a technological solution, because removing any and all bias by hand-curating datasets is just not a scalable approach.
The algorithms reflect and amplify biases in the data. They also go into feedback loops once they affect the reality being represented in data.
Imagine that an algorithm selects individuals at an airport for search. Contraband smugglers are caught. The dataset now includes them, evolving the bias. We have already seen this at play on social media, recommendation engines, fraud detection, etc.
The future is worrying. There are ratchets on technologies such as these. Unless there are extraordinary counter-reactions, they will be "affecting their own datasets" en masse very soon.
The difference is with technology these biases can at least try to be addressed directly and create an objective more fair system.
Technology can address biases but we need to make sure that they are addressed sufficiently, so that we do not end up causing more problems than we solve.
This is a really interesting point that I'll keep in the back of my mind, thanks for that! I hadn't even thought it through in such a concrete manner but I think this really hits the nail on the head.
I actually think it’s probably better than most people’s naked eye recognition in a crowd.
Take DNA testing. We all know that given two samples the odds of a false positive are incredibly low. So DNA testing is a great too for eliminating people who might otherwise be suspects or further evidence against the guilty.
The problem is that given this DNA database, someone decided "let's find our suspect by looking for a match". With 1 in a billion chance of a random match and 100M samples, your chances of getting a false positive are really high.
The problem is that there are instances where a DNA match alone is used to prosecute or even convict people.
In recent years this problem has gotten worse due to the rise of familial DNA matching. Given two samples, we used to only have the ability to say if they were a match or not. Now we can say how much of a match they are. How much of a partial match is enough? What's more, you may be implicated by the stored DNA is relatives.
Facial recognition is far more imprecise than DNA. So yeah I fully expect this to get abused by prosecutors and law enforcement.
If I increase the population I test to include any warm body, eventually I'll end up with more false positives than real positives.
If you are looking for one male suspect and comparing them to all the male faces (let's assume it gets gender correct) in the us, with a 99.9999% (six 9s) accurate algorithm you would get something like:
1 true positive 182,499,818 true negatives 182 false positives
Broad scale facial recognition is just an outright stupid thing to do as a sole measure of identification without the use of other information.
The hardest thing for them with probability is false positives. conceptually it does not seem to align well with how the human brain works. I've had students literally get so frustrated the cry because they know what the math says but can't accept that you can test positive for a disease and not have it. They know they are wrong but it's just this weird sticky misconception.
This seems like a clear example for why facial recognition is a technology that is just not 'solved' yet. The appearance of people's faces, especially from similar ethnic backgrounds, is just too similar for a ML model to parse out with any confidence.
I have noticed this in real life. As I get older, I notice it more and more. I'm sure many of you all have too. There are very distinct patterns, or 'buckets', that human faces tend to fall in. I think our brains tend to naturally categorize them accordingly.
It is probably subconscious. I might not be able to articulate it, or put a definite 'name' on a group. But I know I am constantly seeing patterns of faces in public. People I don't know, and have never met, but they remind me of other random people I have seen in public. Or maybe they remind me of a popular celebrity that everyone knows.
Either way, something goes off in my head. I can't help but think to myself, they must have some sort of similar lineage, or genetic background. I subconsciously categorize them into a bucket with others I've seen.
I imagine this is similar to how Rekognition, and other models work. I thought the blog post from the parent commment @bko, is a fantastic example of this. It is actually amazing, when you think about it, that the ML model can match these faces up as well as it does.
To the naked eye, it is clearly not the same person. Rightly so, considering all the images were in the range of 70-80% confidence. But many are remarkably close. I think this illustrates, the concept I am trying to describe. You can notice it, even with the naked eye.
All of this rambling is to say, I agree with Amazon's moratorium on Rekognition.
As impressive as the technology is, it should probably not be used to try pin-point specific individuals yet, or whatever else folks might be erroneously trying to use it for. If we are to trust facial recognition to identify specific individuals, it should probaly be approaching near 100% confidence, and I imagine that level of confidence is a long ways off.
Now ask if my neighbor looks like any random person on the street, sure, it's small. But that chance we find two people somewhere that look very similar is incredibly high.
"Sally Clark was a practising solicitor before the conviction. After her three-year imprisonment she developed a number of serious psychiatric problems including serious alcohol dependency and died in 2007 from acute alcohol poisoning"
There is already a whole slew of dubious methods[1] (bite mark analysis, blood splatter analysis, fibre comparison) being used to put people in prison/to death, these things are known to be bullshit, but they are still being used. I really think we as technology-literate people should fight as hard as we can against the introduction of facial recognition in the justice system because once it becomes common place it will be really hard to undo it.
[0]: https://www.innocenceproject.org [1]: https://www.latimes.com/opinion/op-ed/la-oe-humes-forensic-e...
This of course means that there are doppelgangers or near doppelgangers all over the place. Even funnier, when i first moved back here from the U.S I was staying at a place in which there was this guy who looked exactly like one of my friends from the U.S, even down to facial expressions and mannerisms (maybe that was because he was always extremely stoned).
Presumably you'd also use the same techniques as used by humans today to narrow down further, like taking into account location, time, etc of match
Move fast and break lives.
For comparison, I did another test where I took one of those youtube videos that shows you the same person's face over ten years. I used the original 12 year old boy as the image I'm using to match. Over 1,300+ images, it had > 70% confidence in all but 4 images (2 had big sunglasses, one the guy was in green-face, and the other one was actually his wife). And this is from a single picture that's ten years old.
The first part I looked at an open-source facial recognition model that did considerably worse.
https://medium.com/ml-everything/how-facial-recognition-work...
> > Only one in a thousand abusive husbands eventually murder their wives
> The more pertinent question is what percentage of murdered women were murdered by their abusive ex-husband?
Shouldn't this be "what percentage of murdered women with an abusive ex-husband were murdered by said ex-husband"?
Yay, we have an algorithm judging people, but is it fair to Canadians? Completely off...
I know how ML works but I believe we should demand better from these technologies than the limits of our own biases.
Right now, this machine learning algorithm is apparently about as smart as a bigot arguing "yea but percentages show that crime is in fact higher among blacks!". It mainly shows how systemic the racism is, that a dumb ML algo picks up on it.
This is not solved by showing the bigot less statistics about black crime, but by showing them how to pull their head out of their ass.
We should expect no less from our ML technologies, otherwise you'll keep running behind the facts, always fixing errors after they have been learned and made.
Yeah that is hard and we have no idea how to approach it. But the alternative appears to be writing computer programs with the reasoning skills of a racist cop.
You're using the strawman and whataboutism logical fallacies, but you're not actually making a point.
From one of the links on the left of the article: https://blog.aboutamazon.com/policy/amazon-donates-10-millio...
> Update, June 9: Since announcing our $10 million donation, we’ve heard many employees are making their own contributions—and we’ve decided to match their donations 100% up to $10,000 per employee to these 12 organizations until July 6, 2020.
Fast Company [2] writes about this as well: "The ACLU in both tests used an 80% match confidence threshold, which is Amazon’s default setting, but Amazon says it encourages law enforcement to use a 99% threshold for spotting a match." That bit of the article links to the CompareFaces API documentation [3] which (still) states "By default, only faces with a similarity score of greater than or equal to 80% are returned in the response".
Have you seen/read something else about this?
[0] https://www.aclu.org/press-releases/aclu-comment-new-amazon-...
[1] https://aws.amazon.com/blogs/machine-learning/using-amazon-r...
[2] https://www.fastcompany.com/90389905/aclu-amazon-face-recogn...
[3] https://docs.aws.amazon.com/rekognition/latest/dg/API_Compar...
Then this whole thing is potentially misleading because there's a huge difference between 80% and 99%. It's probably nonlinear and they could possibly see their false matches drop to 0. This is not a fair test - or rather, the conclusions are not quite supported by the parameters.
Not that I'm defending police use of facial recognition tech, I think it's abhorrent, though possibly inevitable.
I'm deeply troubled by the text I've seen here implying this threshold is some accuracy percentage or positive predictive value percentage. Unless God is working behind the scenes at AWS they can't make any claim about the accuracy of the model on an as yet unseen population of images.
That's even before getting to the more esoteric map vs territory concerns like identical twins, altered images, adversarial makeup and masks, etc.
As for the test, you say it's not a fair test. The point / conversation right now seems to be about the choice of parameters used by the ACLU. As far as I see / understand, the ACLU used the default parameters (and/or those recommended in the documentation / articles that are still up today with those same non-99% values).
What would have been a better / fairer test?
I would bet good money that cops KPI goals benefit from false positives, since they'll reward higher "number of identified/interviewed suspects" and "number of arrests" as a positive thing even if "number of convictions" doesn't line up.
Even more cynically, I'd bet this is a powerful technique for ambitious cop promotion, and that there's little blowback on fraudulently manipulating parameters that adversely affect POC much more significantly that white people.
Thinking about it, I'm now recalling the multiple reports of police departments claiming to not be using clearview.ai, only to have to backtrack when clearview's customer data got popped and it became public knowledge that individual cops were signing up for free trials - which their department/management either chose to hide or didn't know about. That's reasonably compelling circumstantial evidence to me that ambitious cops are quick to jump on unproven and unauthorised technology with insufficient or oversight or with management actively avoiding oversight for them...
If the default is 80, most will be 80. The SE may say “I’m told to inform you that you should use 99.”, but I’m sure he is winking.
Citations?
My understanding was that the ACLU used the default settings.
July 26, 2018 — Amazon states that it guides law enforcement customers to set a threshold of 95% for face recognition. Amazon also notes that, if its face recognition product is used with the default settings, it won’t “identify[] individuals with a reasonable level of certainty.”
July 27, 2018 — Amazon writes that even 95% is an unacceptably low threshold, and states that 99% is the appropriate threshold for law enforcement.
https://www.aclu.org/press-releases/aclu-comment-new-amazon-...
Either way, the defaults are the problem if the application is law enforcement.
"Defaults have such powerful and pervasive effects on consumer behavior that they could be considered “hidden persuaders” in some settings. Ignoring defaults is not a sound option for marketers or consumer policy makers. The authors identify three theoretical causes of default effects—implied endorsement, cognitive biases, and effort..."
I don't think this 99% thing is communicated properly at Amazon if it's getting through blog posts like this.
So I think a valid criticism is that we need to make sure that it's higher.
https://aws.amazon.com/blogs/machine-learning/using-amazon-r...
https://medium.com/ml-everything/how-facial-recognition-work...
With that said, some of their work is still great, and I'm thankful for it.
Remember how McDonalds was the victim of a baseless lawsuit? Well, it wasn't actually the case, but that sure benefitted corporations who can now assert most lawsuits against them are frivolous.
The ACLU would not take the Skokie case today’: https://www.spiked-online.com/2020/02/14/the-aclu-would-not-...
Former ACLU board member Wendy Kaminer:
The ACLU Retreats From Free Expression: https://www.wsj.com/articles/the-aclu-retreats-from-free-exp...
to complaints of sexual violence. We will continue to support survivors.”
The ACLU Declines to Defend Civil Rights: https://www.theatlantic.com/ideas/archive/2018/11/aclu-devos...
Their coffee is just as hot nowadays and to lower the temperature to the degree to where the effect on Stella would have been meaningfully different would result in lukewarm, under-extracted coffee that fewer people would be interested in. Further, the sheer quantity of Mcdonalds coffee moved every year without incident implies user error, rather than product error.
Yes, I know what the jury said and how they divided up the blame. I disagree with their conclusion.
Citation needed.
Stella's own doctor testified[1]:
>Lowering the serving temperature to about 160 degrees could make a big difference, because it takes less than three seconds to produce a third-degree burn at 190 degrees, about 12 to 15 seconds at 180 degrees and about 20 seconds at 160 degrees.
The NCA (a coffee industry group) recommends[2] holding at a temperature of 180-185, due to "rapid cooling", and consuming at or below 140.
Stella's injuries were exacerbated by:
* The hot coffee permeating through thin sweatpants and being held against the skin.
* Her age - 81 years old at the time of the injury. Older skin is damaged more easily[3], and would also have implications for her mobility (how fast she could remove the soaked sweatpants)
Some experiments [4] show that coffee served at 180 will cool to around 162 in 5 minutes, 148 within 10, and 138 within 15. 70% of Mcdonalds business is through the drive-through [5], so must customers would be getting their coffee to go.
The question I'm unable to find a satisfactory answer for is how long it takes the average customer to receive their order and return home. I could probably figure that out if I knew how far the average customer was from their store, but that information is not readily available.
If holding at 180 results in optimum drinking temperature of around 130 in about 15 minutes (per 4), then this is the optimal temperature to hold at for product quality if the average customer lives within 15 minutes of a Mcdonalds.
If you were to hold at 160, using the info from [4], the coffee would fall below this optimum temperature in about 10 minutes and require reheating, which alters the flavor.
[1]: https://web.archive.org/web/20150923195353/http://www.busine... (page 4, bottom)
[2]: https://www.ncausa.org/About-Coffee/How-to-Brew-Coffee
[3]: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3377829/ (It is widely accepted that elderly burn patients have significantly increased morbidity and mortality. Irrespective of the type of burn injury, the aged population shows slower recoveries and suffers more complications.)
[4]: https://www.ukessays.com/essays/mathematics/equation-to-mode...
[5]: https://www.reuters.com/article/us-mcdonalds-meeting-idUSKBN...
Bringing up Stella Liebeck makes me feel irrationally hostile; I've had a negative reaction to people "busting the myth" of that lawsuit on the internet for probably 20 years.
I certainly believe that suing corporations with deep pockets is a reasonable and moral way to deal with medical bills in a country without universal health care. It's not a good system, but if you can get away with it, why not?
And I know well that on average, the scourge of frivolous lawsuits against corporations is a myth, because I've worked in the legal industry and have a perspective based on many other lawsuits.
And if McDonald's served coffee without a properly secure lid, or some other defect then they should be held responsible for every penny of damages.
However, I am irritated by anyone who may insist that it is a "fact" that serving coffee which is hot (but less than 212 deg) is negligent in itself. And if I continue to see this "myth busted" or "fact checked" for the next 20 years, it's not going to change my opinion, because assuming I live that long, I'm going to be boiling water for coffee on my stove almost every day.
It was known by management to be dangerous; that was done deliberately so that people would be forced to sip slowly, to discourage refills. Ain't negligence in light of intent
The point I'm trying to make is not that coffee should be hot, because I know arguing that is futile.
The point is, that framing this as a disagreement about readily available facts is incorrect and if you habitually interpret people's opinions/values this way, it warps your sense of reality to your own detriment.
I think anyone who wants to prevent me from getting hot coffee is not a nice or reasonable person, and I feel threatened by any implication that I would be in the wrong for making hot coffee if someone else spilled it. But these are facts about me, not about the rest of the world. As such, you don't have to accept them, but you can't invalidate them with facts about the world either.
But its also true that responses, like the one you linked to are also often one-sided. And what would you accept from an association of lawyers who make money launching such suits?
The truth is, its not as simple as either side tries to make it out to be. I think the Wikipedia article: https://en.wikipedia.org/wiki/Liebeck_v._McDonald%27s_Restau..., does a good job of presenting pertinent details from both sides.
> McDonald’s operations manual required the franchisee to hold its coffee at 180 to 190 degrees Fahrenheit.
> Coffee at that temperature, if spilled, causes third-degree burns in three to seven seconds.
They might also be interested to know it was composed primarily of dihydrogen monoxide, a lethal chemical agent known to be the proximate cause of hundreds of deaths each year. They are describing boiling water.
Even if McDonald's did the wrong thing, it is a frivolous lawsuit. I serve boiling hot tea to all my guests, it isn't negligence. The case as described seems to be that McDonald's should be civilly liable for serving a hot beverage in a styrofoam cup to a customer who asked for a hot beverage and could easily detect it was in a styrofoam cup.
You hand styrofoam cups out your window to guests you know won’t be staying? Curious social habit.
> a customer who asked for a hot beverage
Coffee is brewed at very high temperatures but is rarely - if ever - consumed at those same temperatures.
https://pubmed.ncbi.nlm.nih.gov/18226454/
For most people, getting a cup of coffee that is near boiling would make for a very unpleasant surprise.
https://medium.com/@CitationsPodcst/episode-107-pop-torts-an...
Huge fan of the ACLU in general, but some of the highly unpopular but incredibly important work they used to do, for example defending neo-Nazi groups right to protest, has been discarded in favor of popular causes.
While I understand why they have gone this way (who wants to defend Nazis in court?) it was a very important symbol of the organizations insane dedication to civil liberties. Taking a principled stand of preserving freedoms for those who are deeply, deeply unpopular is inconvenient and essential.
The ACLU's social media accounts are a mess as well. Their postings come off as unhinged and sue-happy, and the fan base of commenters has become so one-sided, that I think the ACLU simply caters to that vocal audience now. Maybe the change is not solely attributable to that - there might also be a new generational wave of inside actors that simply operate the ACLU in a more ideological manner.
I agree that some of their work is still great. But unfortunately it's been enough of a change that upon weighing the good and bad, I had to finally pull the plug on my recurring donations too.
Just because you share the bias doesn't make it unbiased
Trans women are women. These schools are denying this with this idea, so it seems like a good use of the ACLU's resources to me. Morality aside, I don't know about the legal aspects of defending that principle in the US, but presumably the ACLU have some ground.
>, so that those sports are competitive and fair.
[drifting off the OP topic, but...] shouldn't school sports be about inclusion? what is your ideal of fairness here? For me, the pursuit and rewarding of certain idealised body types selected by narrow athletic criteria reminiscent of pageantry has never been 'fair' for anybody..
School sports ought to focus on inclusive physical self-improvement, help kids develop cooperative skills, resolve conflicts and work together for a common goal, that sort of thing.
Trans women are women from a gender perspective, and not from a biological perspective. Unfortunately, the biological perspective is what the separations of men's and women's sports a thing, because of inherent biological sexual differences (primarily testosterone). I mean, if they want to get around the issue, then let's go all in - disband men's/women's sports and just have sports. Then anyone can play with anyone. That's never going to happen though, for political, cultural, and safety reasons, so we're stuck with a situation where gender is bumping up against biological sex hard.
From a biological perspective, trans-people lie in-between male and female. Transwomen are at an increased risk of breast cancer than cis-men while a lower risk prostate cancer. Transwomen (after years of estradiol) have significantly less muscle mass than cis-men, while, transmen have much more muscle mass than cis-women. All of the differences biologically are the result of sex hormones and the time at which they're introduced (pre-natal or puberty) and the time of exposure.
That said, I don't think it's wise for trans-women to play in serious sports. If they win, they won't get the credit, they'll be told it's because they're trans. If they lose, well, then no one cares and it doesn't make the headlines. It's unfair and unjust, but honestly, sports have never been fair or just. Especially the Olympics, they're a selection ritual for celebrating people who are genetically optimized for some specific task. I don't understand why it exists except for out of tradition.
The challenge is that trans women are women who used to have comparatively vast quantities of testosterone in their bodies, giving them dramatically higher bone density along with all of the other side effects of testosterone on the body.
When they transition fully, the estrogen has a side-effect of preserving the bone density they had previously. Specifically, this gives them a massive advantage in combat sports like MMA. I won't get into the other musculoskeletal aspects that happen.
It's a vexing problem, because I don't like the idea of trans women not being treated like women. It sucks to think about that. It also sucks for non-trans women who are getting their skulls fractured in fights.
The reality is that fans of non trans female athletes aren't going to accept this. When a tiny percentage of the population is trans, and suddenly trans women start winning at the highest levels of female sports at an insanely disproportionate amount, it clearly indicates that being trans provides a massive advantage in female sports. I haven't found any cases of trans men dominating in male sports.
I'm pro trans rights, and also know that my view on this is deeply unpopular in the trans community. I'm not sure what the answer is for this. Sometimes, reality doesn't mesh with our ideals.
Would it work to just group people by bone density and weight class?
Or for MMA, just some sort of scale of ass-kickingness. I would have to be in the can't punch out of a wet paper bag class, which I don't think would get shown on TV. ;)
The problem now is that we're being polarized on an emotional issue with both sides being demonized. E.g. One side says the other is hateful of trans people, the other side says trans is being pushed on them unfairly, etc. If we rather focus on the facts and amoral concepts (e.g. testosterone count), and drive opinion/policy based on that, there is good chance that we can all coexist without having to force opinions and understanding on both sides where it's largely unwanted. Only then can we come together and have a single, happy view on the topic as a society.
Perhaps there needs to be new vocabulary to describe sex and gender separately but that's a different topic. As for fairness, this is the best we can do on a broad scale between male and female because of the vast differences. After that we leave it to the individual to decide which sport best fits their physicality and interests.
I was going to post the same in anticipation of the partisan downvotes that you're receiving. Without going into specifics, this sums it up nicely:
>It’s not that the left shouldn’t have opportunities to speak up against the president’s agenda -- of course it should. But the ACLU shouldn’t be its political bullhorn. The organization’s legal independence gave it special standing. By falling in line with dozens of other left-leaning advocacy groups, the ACLU risks diminishing its focus on civil liberties litigation and abandoning its reputation for being above partisanship
One issue in particular is the ACLU's interpretation of the second amendment, which they do not fight for with the same fervor as the first.
1.https://www.realclearpolitics.com/articles/2018/02/08/the_ac...
Lol, that's because it's Amazon AI. Do you expect better from the makers of Alexa?
But most likely people and organizations will think this work like the movies.
I wonder what would be the score of the actual faces if we added them to the test set (faces, but not the same photos). Would bigger test sets have photos that match the targets more than themselves?
What percentage of the arrest photos were people of color? Was it significantly more or less than the 20 percent people of color in congress or about the same?
Do you understand what a badly designed experiment this is?
https://www.aclu.org/press-releases/aclu-challenges-fbi-face...
https://www.aclu.org/press-releases/aclu-challenges-dhs-face...
Would be great to see Amazon's support.
The ACLU ran an experiment with Rekognition and these are their findings:
"Using Rekognition, we built a face database and search tool using 25,000 publicly available arrest photos. Then we searched that database against public photos of every current member of the House and Senate. We used the default match settings that Amazon sets for Rekognition.
... the software incorrectly matched 28 members of Congress, identifying them as other people who have been arrested for a crime.
... Academic research [0] has also already shown that face recognition is less accurate for darker-skinned faces and women. Our results validate this concern: Nearly 40 percent of Rekognition’s false matches in our test were of people of color, even though they make up only 20 percent of Congress."
https://www.aclu.org/blog/privacy-technology/surveillance-te...
[0]: http://proceedings.mlr.press/v81/buolamwini18a/buolamwini18a...