News for hackers. Stuff that matters.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:20AM (#19726807)
> he won't get 1bn, that's not the point

That was my point, though. He’s abusing the legal system by asking for compensation he knows he will not receive to gain publicity. The issue involved is fine but I’m not a fan of exploiting and clogging up the legal system in this way. If this is “what it takes” I think we have a bigger problem we need to solve.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by huffmsa on Tuesday April 23, 2019 @05:34AM (#19726870)
Such a large figure means Apple actually had to take it seriously, even though it's only ~0.5% of their cash on hand.

If he sued for some trivial sum, they'd probably just pay him to go away.

And yes, publicity is the point. This is how you get new precedents established.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:59AM (#19727009)
They’re going to do that anyways. Most likely the case will be settled so the guy goes away and the press dies down; he’s not going to continue his moral crusade against Apple violating his privacy after that.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by duiker101 on Tuesday April 23, 2019 @05:29AM (#19726849)
He should sue for 10k so Apple can dismiss him, not feel any repercussion and no one will talk about this anymore. /s
Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:43AM (#19726924)
I mean, $10k seems like a reasonable compensation to me. It sucks that he might not get as much news attention, but I don’t think that’s what a lawsuit is supposed to be. The newsworthy bit should be the wrongdoing, not the outrageous demands; he could have tried to get support for his plight without the claim.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by apatters on Tuesday April 23, 2019 @05:54AM (#19726980)
The argument behind entertaining huge fines or damages in tort cases is that it acts as a deterrent against future violations of the law. If the damages were only $10K then Apple would have less incentive to create safe software and fix bugs like this one. If the damages are a potential $1B they will take the issue seriously. It is fine when the defendant is a huge company like Apple IMO.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @06:03AM (#19727037)
But what law was violated here? The only thing I see is that the individual involved felt they were harmed by Apple in particular.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by mirimir on Tuesday April 23, 2019 @06:23AM (#19727141)
Giving bogus information to the police? That is, lying to the police. That is a crime.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by zimpenfish on Tuesday April 23, 2019 @07:50AM (#19727645)
But what bogus information did they give? If the thief used his ID, it's not like they can give the police another name, is it?
Re:Apple Face-Recognition Blamed by New York Teen for False ... by mirimir on Tuesday April 23, 2019 @06:17PM (#19733534)
They provided video of someone they claimed was this kid. But it was actually someone who apparently used a stolen or counterfeited ID. And not really even that. It was likely someone who their facial recognition system matched with someone who had used that ID.

Maybe I'm just naive, but I doubt that people typically get arrested based on such iffy identity theft. It wasn't a photo ID. And such ID is typically useless for legally meaningful authentication. It won't get you alcohol when you're underage. It won't get you a bank account. Or a drivers license, or even a replacement social security card.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by nullc on Tuesday April 23, 2019 @05:31AM (#19726857)
How big does the penalty need for it to actually make avoiding it in the future a priority for Apple?

Putative damages need to scale with the size of the defendant or they're meaningless.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:35AM (#19726876)
As far as I can tell, this is strictly supposed to be compensation for hardship. The size of the entity that is causing the hardship doesn’t affect the amount of suffering. So why should the payout be different? (Otherwise I’d just seek to be wronged by the organization with the biggest pockets?)
Re:Apple Face-Recognition Blamed by New York Teen for False ... by salthound on Tuesday April 23, 2019 @05:49AM (#19726953)
The law provides remedies: someone has been wronged, and the legal system provides recourse. The law also regulates conduct: the punishment acts as a deterrent, to avoid similar violations in the future.

A negligible settlement won't act as a deterrent for an entity with deep pockets.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by kuzehanka on Tuesday April 23, 2019 @05:42AM (#19726922)
If we keep letting a corporate entity get away with undesirable practices by merely slapping them on the wrist, we are actively signalling to them that they should continue to engage in those practices.

The only way to stop a corporation from doing something undesirable is to make the punishment great enough that the undesirable act is a net financial loss to the corporation.

I would personally fully support massive % of yearly revenue fines for anything to do with privacy.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:44AM (#19726935)
Work on making it illegal, then, so that corporations can be properly fined instead of random citizens having to justify billions in damages.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by salthound on Tuesday April 23, 2019 @05:57AM (#19726997)
I don't understand this. Work on making what illegal? Facial recognition? Or breach of duty? Or making mistakes?

It seems to me that we already have the proper way of dealing with this situation. Have the company pay punitive/exemplary damages.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @06:01AM (#19727022)
Actually, that brings up a good point: what exactly should the remedy in this case be? I don’t think it’s clear that Apple is even at fault here. It’s a pretty shaky case and I’d place more blame on the officers who arrested him without double-checking than an in-store camera.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by kuzehanka on Tuesday April 23, 2019 @05:54AM (#19726979)
Just because something is illegal does not stop a corporation from doing it. If the financial penalty for an illegal act is less than the financial gain from carrying it out, it will be carried out.

See: petrochemical pollution, bank money laundering, telcos selling customer data, etc.

Legal or not, the discussion is whether a 1B punishment is appropriate. Yes, I think it is appropriate for an organisation with a reported quarterly revenue in the 90B range, maybe even on the low end.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:57AM (#19726999)
By making something illegal, the government can go after the company by representing the collective will of the people it stands for. I think it’s much more reasonable to have billion dollar fines in that case.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by sarcasmOrTears on Tuesday April 23, 2019 @06:17AM (#19727114)
I think corporal punishment along with money would be great as punishment when it comes to corporations/rich people. Maybe only for the next 5-6 years, just enough to clean around.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by viraptor on Tuesday April 23, 2019 @05:33AM (#19726868)
What do you mean by clogging up the legal system? It doesn't matter how much he asks for really. This should be a valid case and it should cost Apple enough to hurt them.

We can't tell what the arrest was worth to the teenager. Depending on timing and results on his life, that could be anything between mild inconvenience and 1bn.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by danaris on Tuesday April 23, 2019 @08:34AM (#19727939)
> This should be a valid case

Why?

All Apple did was provide the police with the information they had, in good faith: that is, the information on the ID the thief had.

It's not Apple's fault the ID was stolen and the information was false. It's also not Apple's fault that the police didn't do basic due diligence to determine if it was physically possible for this guy to have committed the crimes before arresting him.

What, exactly, is Apple to blame for here that "this should be a valid case and it should cost Apple enough to hurt them"?

Re:Apple Face-Recognition Blamed by New York Teen for False ... by sigzero on Tuesday April 23, 2019 @10:25AM (#19728895)
The answer is nothing. Apple did exactly what they should have done. The police failed to follow up properly.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by logfromblammo on Tuesday April 23, 2019 @11:27AM (#19729549)
The police follow different procedures based on who is making the report.

If you are an individual, and someone steals your iPhone, then you use the locator feature to pinpoint the exact address where it is, look up the name of the person living there, have a plausible story for why that person had opportunity to steal it, dig up the serial number from your records, and hand all that info over to the police, they will give you a report that you can give to your insurance company, caution you against approaching the thief yourself, and do literally nothing else. You did all the investigative work. All they'd have to do is show up with a search warrant. Aaaand nothing happens.

If you are Apple, and someone steals your iPhone, then you use facial recognition tech to link the thief to the name and address of a stolen identity, then the cops will raid that address and arrest the person, without even bothering to investigate, or even validate Apple's info, first. Perhaps they call a VIP number rather than 911 or the public number for the main automated phone tree, that bypasses all the layers of "we're busy with important work, so piss off"?

This is the same problem as SWATting attacks. Police procedure is hackable, by saying the right words to the right people, to turn it into a guided weapon against a target, who is occasionally killed by a cop made too twitchy by the "everyone wants to kill you" training.

Apple provided false information to the police. This resulted in an arrest, which is potentially traumatic and violent. They could have given just the video footage of the thefts. But instead, they became part of a system that hacks police procedure to launch attacks against innocents. Someone was arrested on the basis of the output of a facial recognition program, without any consideration to the fact that it had been hacked, using the very simple and very easy attack of linking the face to someone else's name.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by danaris on Wednesday April 24, 2019 @08:49AM (#19737789)
Why would giving the the video footage, and not the ID information they had on file, have been better?

Consider it from the perspective of not having the information that the ID was false. Why would you give the police less than all the information you had? Why would you want the police to have to do all the work to figure out who that face on the video is, when you have their ID?

Furthermore, even if you knew the ID was false (or even suspect), giving the ID information to the police, along with your assessment of its validity, would still be better. They would have an extra data point to use to try and trace the real thief.

And, again, the facial recognition program did not perform the identification of the thief. It merely linked his presence in multiple stores at the times of theft. The identification information came solely from the stolen ID the thief gave when he purchased something legitimately in one of the stores.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by logfromblammo on Wednesday April 24, 2019 @12:28PM (#19740044)
I operate under the assumption that the majority of cops are just doing the job for a paycheck, and not out of any genuine desire to do the job correctly arising from a professional work ethic. I get it--it's just like every other job. Only a few people actually care about what they do, and the rest know what it means to just be an employee.

Giving the footage, without the name, forces the cops to positively identify the suspect through investigation of crime scene evidence. The FaceID-generated name is just speculation from Apple.

Operating under the assumption that the cops will do the absolute minimum amount of work to clear the case, just giving the video runs the risk that they will decide that identifying the suspect is too difficult, and give up. But bear in mind that they failed to identify the real suspect anyway, and also arrested an innocent person, just because Apple said that's the person who did it.

The professional cops, who are usually not as knowledgeable about computing science as the professional software developers, may be unaware of the GIGO principle--garbage in, garbage out. They don't know how Apple assigned a name to the face, but they trust them, because Apple spends a lot of marketing dollars getting people to believe that all their stuff "just works".

The facial recognition software linked the face with a name attached to all the faces that didn't. Apple can certainly give a rate of false positives and false negatives for the face-matching, but I'm not sure they have any idea how many people are showing them fake IDs. That's something cops and bouncers would know, not ordinary retail employees.

If you were a cop, and someone dropped this case on your desk, what would you do? I, personally, would search for that name on every corner of the Internet before getting off of my ass. I'd be looking for any excuse I could find to not go out to arrest someone, because that's work, and solving property crimes, especially shoplifting cases, is not noteworthy or glamorous. But Apple is rich, so I'd put just a tiny extra effort in to find the real thief, in case I ever wanted to run for sheriff, and get them as a corporate campaign donor.

I'd probably go to one of the department's fake Facebook accounts, upload a cropped still from one of the videos, and see if their auto-tagging software produces a match. If that didn't come up with anything, I'd have to get a search warrant for the named suspect and their home address, looking for any stolen Apple stuff. Then I'd see that the named suspect does not match the video footage. I'd give the best face-shot and a short video clip to the local TV news to see if that generated any tips or leads, and then finally write a report saying that the suspect could not be identified or located from the available evidence. But I'd be polite about it, because Apple is rich, and would certainly want to read the report. And then that would be it. Because every retailer has to live with a nonzero amount of shoplifting and other forms of shrinkage, even the rich ones.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by danaris on Wednesday April 24, 2019 @05:57PM (#19742984)
> The FaceID-generated name is just speculation from Apple.

No, it's not. As I've said multiple times, the name came from the stolen ID the thief had. The only use of facial recognition in this case was to link his presence at the time he gave the ID, to his presence at the other stores where thefts took place.

Facial recognition played no role in actually identifying the thief (either the actual one or the poor sap whose ID was stolen).

Re:Apple Face-Recognition Blamed by New York Teen for False ... by logfromblammo on Thursday April 25, 2019 @12:53PM (#19750033)
Do you realize that the first paragraph of your post directly contradicts the second?

1. Facial recognition played a role.

2. Facial recognition played no role.

One of the two must be false. It is the second. Facial recognition played a role. Specifically, it linked the face seen in video where a crime was observed to a face that misidentified itself.

The speculation on Apple's part was that the name the face presented for itself was genuine, and not a deception. It did not stop to assess the probability of all customers presenting fake ID, or the conditional probability of a customer presenting genuine ID given that they are a suspected serial shoplifter.

That last one is relevant. A person that can do a grab-and-run theft might also be willing to do a fraudulent purchase theft by giving a stolen, cloned, or credit-fraud card and stolen or faked ID. So while you might be able to assume that regular customers usually give genuine ID, giving fake ID and stealing from retail stores are probably not independent events. Once you have reason to believe a person is stealing, based on the facial recognition matches, you can't trust that they are who they said they were with the same confidence.

And what would Apple have done if the same person had given a different stolen or faked ID, on a different occasion, and that name was also linked to the case by facial recognition?

Re:Apple Face-Recognition Blamed by New York Teen for False ... by danaris on Saturday April 27, 2019 @09:32AM (#19765396)
Apple is not the police, and it's not their job to solve the crime for the police. It's their job to hand over all relevant information so the police can solve the crime. And what would Apple have done if they had identified this person instead by good old-fashioned human facial recognition, in one store—they check their security camera records, see the person who gave the ID, and spend some time matching it up with thousands of dollars worth of theft in the same store. They would likely have done just the same: handed the ID over to the police, along with the information about the thefts.

My first paragraph does not contradict itself. Facial recognition software was not used to identify the thief. That was purely done through the use of the ID. Facial recognition software was then used to link the already-identified thief in a single instance to other instances of theft at other stores. Even if the facial recognition software had never been used, the guy the ID was stolen from would still have been fingered as the thief in that first instance.

This is not a story about Big Bad Apple, or Big Bad Technology Gone Wrong. This is just a story about Humans Making Mistakes. Specifically, it's a story about the police not doing their due diligence.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:39AM (#19726904)
> This should be a valid case

Agree.

> it should cost Apple enough to hurt them

Don’t. I think it should cost them proportional to the amount of “suffering”: this is a lawsuit after all, not a criminal trial.

> We can't tell what the arrest was worth to the teenager. Depending on timing and results on his life, that could be anything between mild inconvenience and 1bn.

Agree as well, but I hope you can forgive me for leaning towards “mild inconvenience” rather than “one billion dollars”.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by NickNameNick on Tuesday April 23, 2019 @07:23AM (#19727446)
There are two seperate parts to a financial judgement. Reparations - which are paid to the victim to make them whole

and Punitive damages - which are paid to the court to discourage the behaviour of the defendant.

Both parts need to be considered.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @07:55AM (#19727673)
As far as I understand, the quoted figure was meant to be reparations.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by gridlockd on Tuesday April 23, 2019 @06:27AM (#19727158)
> That was my point, though. He’s abusing the legal system by asking for compensation he knows he will not receive to gain publicity.

Asking for an unrealistically huge sum is par for the course. The judge can arbitrarily reduce that sum down, all the way to zero.

> The issue involved is fine but I’m not a fan of exploiting and clogging up the legal system in this way.

The legal system isn't being exploited or clogged up, he was going to seek damages (as one should) in either way, whether the number sought is a billion dollars or a thousand dollars doesn't make a difference.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by tareqak on Tuesday April 23, 2019 @05:28AM (#19726841)
What’s a fair price for being responsible for causing a false arrest then?
Re:Apple Face-Recognition Blamed by New York Teen for False ... by lotsofpulp on Tuesday April 23, 2019 @06:21AM (#19727129)
The only entity responsible for causing a false arrest are the police, as they are the ones that have the authority to arrest. Unless they were intentionally given fraudulent information, I don’t see how anyone other than the police are responsible for a false arrest, it is their duty to do due diligence.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by mirimir on Tuesday April 23, 2019 @06:28AM (#19727159)
It seems likely that Apple said that they had video of him stealing from them. But they obviously don't. So if they said that, they were lying.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @07:58AM (#19727696)
I don’t know why you’re bringing up these hypotheticals: Apple is equally likely to have not lied to the police. Do you believe they were purposely acting in bad faith?
Re:Apple Face-Recognition Blamed by New York Teen for False ... by mirimir on Tuesday April 23, 2019 @06:07PM (#19733442)
I'm not arguing that they "act[ed] in bad faith".

I'm arguing that they misused data that they had. And so they actually didn't have enough evidence to file a police report.

But it's also arguable that the police screwed up, by not noticing that the photo from the video didn't match the suspect. So maybe the kid should also sue the police for false arrest.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:33AM (#19726867)
No idea, that’s something that will be decided if the the lawsuit ever goes to court. But I’m pretty sure that the final value will be significantly less than a billion dollars.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by lexs on Tuesday April 23, 2019 @05:38AM (#19726894)
so why does it matter what he originally "asks" for. The court will decide not the accuser.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:48AM (#19726951)
Because it looks like the person is using it to drum up publicity, possibly in an attempt to get Apple to pay them a decent settlement to get the media to shut up. I’m not really a fan of people using the legal system in this way.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by DanAndersen on Tuesday April 23, 2019 @07:35AM (#19727539)
What should be the exact dollar amount to avoid "looking like he's using it to drum up publicity"? You presumably have some idea of what the "right answer" is since your gut is telling you $1bn is too much.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by hopler on Tuesday April 23, 2019 @07:57AM (#19727683)
If I was mistreated by the police for a few days with no permanent harm, arrester on insufficient evidence, the police should pay me a few hundred or thousand dollar a day, maybe. Apple should pay nothing because because they did nothing wrong by sending evidence to the police.

The real problem is that the government considers arrest without conviction to be a civil duty, not a tort.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @07:58AM (#19727700)
I dunno, maybe a couple thousand dollars, assuming there was no permanent harm?
Re:Apple Face-Recognition Blamed by New York Teen for False ... by ryanlol on Tuesday April 23, 2019 @08:09AM (#19727781)
Obviously there’s permanent harm from an arrest. Have you never submitted a visa application?
Re:Apple Face-Recognition Blamed by New York Teen for False ... by larkeith on Tuesday April 23, 2019 @05:51AM (#19726962)
> If this is “what it takes” I think we have a bigger problem we need to solve.

Well, yes - we do. Using publicity (via mass media and/or the legal system) is, at this point, one of the few recourses citizens (at least in the US) have against tech giants when they engage in morally-questionable behavior. In the idealized capitalist world, we could move to competitors, but the current situation is that a number of markets are extremely monopolistic (search engines, online markets, platform app stores) or duopolistic (mobile devices, computers, news aggregation) - and consumer apathy, combined with toothless or entirely missing regulation, trivialize the impact of anything except for the most visible of reactions. If there were stronger legal repercussions in cases like this, it would make publicity stunts unnecessary.

Re:Apple Face-Recognition Blamed by New York Teen for False ... by saagarjha on Tuesday April 23, 2019 @05:52AM (#19726971)
The publicity is obviously focused on the wrong thing, though: that’s exactly why we’re having this discussion instead of talking about the privacy implications.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by fxfan on Tuesday April 23, 2019 @05:36AM (#19726883)
The publicity is not kids fault, its engadget's and media's. They want eyeballs. Anyone with the most basic legal knowledge knows that's not how damages work and he won't even get a million.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by hopler on Tuesday April 23, 2019 @07:58AM (#19727695)
If apple giving evidence to police is their fault, then the kid giving a billion dollar lawsuit to the media is his fault.
Re:Apple Face-Recognition Blamed by New York Teen for False ... by mmjaa on Tuesday April 23, 2019 @09:12AM (#19728222)
He's only "gaining the publicity" you're giving him, by ignoring the subject of the case: Apple programmed their computers to catch a citizen, so they could turn that citizen over to the police - but they screwed up and programmed their computers to catch the wrong person, therefore delivering on a promise that has been made, time and again by one dystopian author after the other, and which demonstrates the fact that we must always be willing to face up to abuses of technological power, whatever the cost.

Hey, a billion dollars got your attention. Perhaps, in fact, after investigating it: we will find that in fact Apple has done more than a billion dollars worth of damage to society. If they can screw up like this once - perhaps there is more? 100 more cases, perhaps?

We will see, once enough publicity from this "abusing of the legal system" runs its course ... considering that, indeed, there may in fact be bigger problems to solve.