No, nothing is "just a tool". Surveillance technology enables all sorts of new attacks. Automation makes things feasible. Cheap storage that allows weeks or months of security footage to be preserved changes what's possible. License plate scanners are "just" a technology that could be done with a bunch of cops on corners with notepads, but in aggregate they're a tracking of where everyone is and has been that could never be done without the technology. Facial recognition is very similar.
Lots of new technology has some downsides, the laws should more specifically target the downsides instead of require that everyone pretend the technology doesn't exist. If nothing else, it's just far too impractical for a technology that is easily available and in everyone's pocket to be illegal to use. It will just incentivize obscuring and lying about using it, rather than truly prevent it from ever being used. It reminds me of the history of banning encryption, you're basically just making math illegal.
Sure, but like any other tools it also enable all sorts of new benefit.
The preferable action would be to take advantage of the benefit while also try to fix whatever it is that cause problem with the tools instead of simply banning it.
government monitoring people by itself is not a problem, government monitoring people to harm people is the problem.
What need to be fixed is the usage of tools to harm people, not the tool itself.
I thought the election of Trump would disabuse people of this idea that it’s smart to hand more and more power to central authorities. But at this point I think it’s hopeless. People just want the state to be Daddy, and assume or hope that its power will always be wielded by people they like against people they don’t.
Moreover, yes, other deeply awful weapons are also banned. Biological weapons and Chemical weapons are both widely banned by all decent countries in the world. Nuclear weapons should join this list. They almost did, during the Reagan era: https://www.theatlantic.com/politics/archive/2016/01/ronald-...
The problem is automated identification of faces. The solution is banning that.
According to this, 405, which is 405 too many.
You can't build a system of robots without some fault-tolerance. How are humans supposed to keep up to that?
Based on this data - how can you make the assumption that a police interaction is an inherent risk to life that is always unjustified?
We mostly pay police to show up and be generally aggravating to people who might be doing bad stuff - in some sense "being sketchy in the vicinity" is a valid reason for police action, which doesn't even always turn into an arrest, let alone a life-or-death situation. Those cases are the vast minority of police interactions total.
I also just looked at a few unarmed shootings at random to get an idea of what they were like. Of the three I looked up I saw one guy who was shot while fighting with a police officer after being discovered at the scene of a burglary. One guy who was shot after a car chase when, after they had caught him, he got behind the wheel of a police car and the police shot him to prevent another chase. One guy, after stabbing someone to death and being approached by multiple police officers, faked a draw to "suicide by cop". My point is, I don't think it's even clear that all (or even most) of the 50 unarmed shootings are unjustified.
If it's illegal to be armed, you should change the constitution, rather than asking police to shoot evry armed person they see
Whats the problem with this ?
The problem is when they use it to harm me.
What need to be fixed is The government record, observe and judge every single thing a person does to harm people.
>to subject everyone in a society to that kind of scrutiny would just be laying the foundations for abuse
It can be used for abuse but not always, It can also be used for good, what need to be prevented is the use for abuse.
When it comes to facial recolonization or AI in general, could anyone really tell you why the computer decided to flag your face and why another similar one was rejected? Would you accept a search warrant when the judgement wasn't based on any human's perception but something which came out a black box? Who makes sure that the data sets used to train the models was 100% free of bias?
If that's not enough, make a human sign off that they have confirmed or at least agree with the black box's conclusion, and put the department on the hook if it was obviously wrong.
> Who makes sure that the data sets used to train the models was 100% free of bias?
The box is comparing a source image to an image with a name attached to it. Like you said, no different than a human would do, with all of their own biases in play. We aren't talking minority report here, so there's no reason to think this is a hurdle that would be difficult to overcome.
Utah’s e-warrant program has a 98% approval rate. Some warrants are approved in less than 30 seconds.
Warrants across the US are frequently approved on evidence as shaky as a single anonymous tip.
The problem (at least in my opinion) isn’t that facial recognition itself is inherently evil, it’s that:
a) There are no standards around the algorithms themselves in terms of reliability. Worse still, this can inadvertently lead to serious racial bias.
b) It can launder lousy evidence (this person looks vaguely like this grainy photo) into solid scientific evidence (the algorithm says it’s a 99.5% match!) providing justification for all sorts of warrants and raids on even flimsier ground.
c) It creates lousy incentives in favour of creating a surveillance state. The police already have out-of-control hardware budgets, and many don’t like the idea of that budget being used to monitor and record people at all times they’re in public.
If we had better police and court systems and better privacy law this might not have been necessary - but we live in the world we live in so I can see why this county would do this.
Here is the crux of the problem. If facial recognition were good, then it would actually make things better. If it were bad, then it isn't making things substantially worse- if anything, it creates a track record which makes things like racial bias more obvious and auditable.
The real issue is that there isn't sufficient judicial oversight, nor recourse for when it fails.
At least in the United States, any encounter with law enforcement can potentially end in violence, so anything that makes it easier to get a questionable warrant will make things worse.
If you are stuck living somewhere where music is illegal, and you happen to listen to some music on the sly and get caught by a perfect system, and punished, how is that better?
Better would be if people can live freely without having to worry about a perfect system tracking their every action.
There is no person alive on earth today who does not do things that would get them punished under the law of some government somewhere.
And you want the law enforcement systems to be perfect?
Facial recognition isn't going to care that you procured illegally distributed copies of protected works (your ISP already does that anyway), so lets stop moving the goal posts. It is a reactive, not proactive system, and while I am not fully convinced that it is actually ready, I am also not buying the slippery slope nonsense.
Sorry, I wasn't clear maybe, but somehow you misunderstood me.
I wasn't talking about pirated music.
I was pointing out that some regimes have laws that forbid listening to music, period.
Fixing bias doesn't help when all it does is help accurately catch innocent people who in fact were accurately detected to be doing innocent things, and punishes them for doing those innocent things because those innocent things are illegal in that country for no good reason.
>Since when do search warrants get automatically approved by a black box? It is on the judge to approve, not a machine.
The USA PATRIOT ACT removed judicial oversight and allows for warrants to be issued that notify the judiciary and simultaneously issue gag orders on those notified. For federal cases warrants no longer require judicial approval in an undisclosed number of cases. Try and find a list of current Guantanamo Bay detainees or the judges who approved the warrants used to detain them. Until that’s dealt with I see why King County would ban this use as a defense against automated enforcement.
Class Activation Mapping [0] and Salience Maps are some of the most used and intuitive approaches. Lime and Shap [1] are tools to visually represent feature activation in an understandable way.
The idea that we have no idea what is going on with machine learning models is just flat out wrong.
Isn't every PD that uses facial recognition keeping a human in the loop to confirm algorithmic matches first? And if so why would the overall process be any less accurate than a human match?
You could argue that humans make similar mistakes and bias, but the scale is always smaller when humans are involved, just because of how slow they are.
Say a model is wrong 37% of the time, and so are humans, but the model runs 1000 times a minute, where as humans perform the task 10 times a minute. That means the model makes 370 false accusations a minute, where a human makes only 3 a minute.
In effect, the number of people you bothered falsely accusing is still less when done manually, simply because it can't scale.
Lastly, there's an argument that the police shouldn't be too efficient, because some crimes might be better off existing in a grey area.
People do fear police supremacy and police states, the idea that they can find you for j-walking or jumping a fence as a dare, etc. Or that the state could become authoritarian, but you'd have no way to fight back as rebels due to advance tech of surveillance the police would have, etc. I'm not saying those are justified, but I think it plays into it, people are fine saying that only the highest risk cases are worth pursuing, but if a tech comes along that lets police pursue all cases, it might start to feel abusive to people.
P.S.: I'm neither against nor in support of a ban here, I'm still making up my mind, just answering some of the reasons I know off for being for the ban.
It’s one of the things swept under the umbrella of the “CSI effect.”
Or they spend 100x as many man-hours and achieve the same number of false accusations, but at a much higher cost to the taxpayers.
It seems like we should then ban eyewitness testimony. That has tons of accuracy issues and bias.
A great example is the Capitol Riots. They are narrowing the list down to manageable numbers. They aren’t suddenly arresting thousands of people for a crime committed by three.
Facial recognition is the enabling technology for automated real-world repression. Maybe it is true that we can find a way to tame it to gain efficiency gains without destroying open society. But right now it looks like a dangerous one-way ratchet.
"The satnav directions say to turn onto this pier."
"The model says this house is worth 200k less than the ones in the whiter neighborhood a quarter mile away."
"The system recommends the patient have 40% allocated home health care hours per week going forward."
"The algorithm says this grainy footage of someone far away from the camera in the dark and the rain is X."
If you put humans in the loop informed by an algorithm making judgements, the human will often defer to the algorithm. Does the algorithm give an output that indicates its uncertainty? Based on what model? How equipped is the human to consider that?
>"Facial recognition" means an automated or semiautomated process that assists in identifying, or verifying the identity of, an individual based on the physical characteristics of an individual's face.
So I have a still from security camera footage. And I have 50,000 mug shots stored in the mug shot data base. I can see that it's a man in the image, he's white, between the ages of 15 - 50. So I go to my computer and put in the filter for the mug shot database to include those criteria. Sounds to me like I just used a semi-automated method to attempt to identify the person in the still image.
This ordinance is dumb. The use of a computer to pattern match, to automate what a person can do, is a lever that makes everyone more efficient. What's the logic in making someone thumb, or click through, every photo in the state's mug shot collection instead of allowing a system to reduce the possible candidates, if any.
But if you didn't record or have access to those fields, and you tried to infer age, gender and race from the photo, and then filter -- well, what if your system is much more accurate guessing ages for some racial groups than others, or more accurate in distinguishing between white and latinx than between latinx and asian? Suddenly your "filtering" process can also have a bias problem, where some people are more likely than others to be included in the results for a query which shouldn't actually include them.
A case agent looks at the still photo from security footage, concludes the person is male and white. They put that information into the mug shot database and it returns the subset of all mugshots that are male and white. They have just used a semi automated system to assist to ascertain the identity of the person in the security footage based on the physical characteristics of their face. This is forbidden by the ordinance.
>what if your system is much more accurate guessing ages for some racial groups than others, or more accurate in distinguishing between white and latinx than between latinx and asian? Suddenly your "filtering" process can also have a bias problem, where some people are more likely than others to be included in the results for a query which shouldn't actually include them.
What if it isn't? Doesn't matter. It's a tool to attempt to match two photos. If a tool is not as effective due to the way light and different skin tones interact, it just limits the leverage factor of the tool. It doesn't make it wrong and it isn't an infringement on people's rights. We use DNA matching even though it can't distinguish twins and sometimes it comes back and says it's a close match for Bob which leads them to suspect Bob's brothers family, e.g. Golden State Killer. I fail to see why tools have to be perfect or not be useful.
I generally don’t want my government to “move fast and break things”
They are making their own bed in many cases. Here's one of several interesting moves by Clear View AI, for example: https://twitter.com/RMac18/status/1220876741515702272
I'm way more scared of guns than I am of facial recognition and as a country we will never ban guns.
I'm not for an instant saying that there aren't any implications in terms of how the technology can and should be deployed - but some people just want to be angry and offended despite a lack of understanding of what they're actually on about.
Facial recognition struggles to accurately identify black people and women.
The difficulties around both are probably around edge and contour detection:
Black people have darker skin and less angular features - the shadows on their faces are not only harder to see (due to blending with skin-tone), but softer to begin with.
Women routinely leave the home wearing enough makeup to not only look less like themselves, but often look more like other women.
There are ways to mitigate these issues to some extent: cameras that work better in low light and codecs that do a better job of encoding relative rather than absolute light levels will do a better job of preserving the information in the faces of people with darker complexions.
As far as makeup is concerned, it can misrepresent the shape of a face - if you only have one angle.
Treating the face shape as invariant as Δt -> 0 and running on video (even better with multiple synchronised cameras) will allow for topography extraction despite dealing with someone deliberately misrepresenting what they look like.
Compare that with the usable colours and bad blacks of standard absolute colour encoded video.
Are there many sincere researchers studying flaws in facial recognition advocating its unequivocal ban forever? Joy Boulamwini:
> At a minimum, Congress should require all Federal agencies and organizations using Federal funding to disclose current use of face-based technologies. We cannot afford to operate in the dark. https://www.govinfo.gov/content/pkg/CHRG-116hhrg36663/pdf/CH...
Timnit Gebru in the NYTimes:
> Do you see a way to use facial recognition for law enforcement and security responsibly?
> It should be banned at the moment. I don’t know about the future. https://archive.is/JqiqP
Are the flaws Algorithmic Justice League finding real? Someone has definitely been wrongly accused by a facial recognition error (https://www.nytimes.com/2020/06/24/technology/facial-recogni...).
Is there certainly an impression that activists want a forever ban? Yes, Joy Buolomwini and Timnit Gebru are frequently represented as advocating against even "perfect" facial recognition.
It's true, lawyers tend to advocate for a forever ban. I don't think these researchers advocate for a forever ban. If you read their raw words, they are much more intellectually honest than the press allows.
Is your line of thinking co-opted by people acting in bad faith? Certainly. You would feel very differently about the deployment of the system if you were so much more likely to be falsely accused by it due to the color of your skin.
Every intellectually honest person's opinion of the justice system eventually matures. You'll come around to delegating authority to researchers over lawyers and police.
For example, there's no law against making one phone call to a random number in the phone book. But if you use an autodialer to call everyone in the city, you're breaking the law.
typically you find the balance....right now you are suggesting that the improvement is a convenient way of increasing security but the reality is, that security in one sense can lead to loss of it in another.
example. Assuming all things are Good and no possibility for corruption then it would be purely beneficial....but since those aren't controls, and not realistic either, we cannot sacrifice security for convenience in this case.....if that makes sense.
"Can't ban math", that's like saying "can't ban words". Yes, but you can ban a combination of words in a location, such a "There's a fire!" in a crowded theater. You can ban a combination of math in a police station that leads to people going to jail.
That's a limiting aspect of the physical world less light back = less details. Flagging footage for manual review doesn't need to be bias free just the end component that actually effects the person in the video.
Yelling fire in a crowded theater is legal.....
https://www.theatlantic.com/national/archive/2012/11/its-tim...
That is, I am not sure if it makes sense to ban the software if it is less biased than the human. But it might make sense to ban it if it is more biased.
There are loads of people of color who have been falsely imprisoned for looking like someone in a grainy security camera footage well before facial recognition technology was widespread.
It's clear to me that there should be a line to prevent fully convicting someone of a crime without any humans in the loop at all. Don't replace the jury or public defenders with robots. But facial recognition could just be a way to look through a large amount of footage to find relevant clips that would then be reviewed in more detail by humans. Without facial recognition, you just pay cops overtime to look through footage themselves. It doesn't necessarily affect the outcome of the process at all.
I think facial recognition just needs some help with its image, it's just a tool that would save tax dollars. Or a means to Defund The Police, if that's your thing.