News for hackers. Stuff that matters.
Re:A Screeching Voice of the Minority by robertoandred on Sunday August 29, 2021 @10:05PM (#28352194)
Apple does not report you to law enforcement, as this article claims. The article also ignores human review.

The article compares scanning to facial/object/scene recognition, which it can’t do.

The article talks about making it easier to find who took a photo, which is not the problem the Jan 6 sleuths were trying to solve.

The article worries about China, but ignores that matchable photos must appear in multiple jurisdictions’ databases.

The article also ignores the several points of third-party auditing and several layers of human reviews.

Re:A Screeching Voice of the Minority by JimDabell on Sunday August 29, 2021 @10:33PM (#28352323)
There seems to be several misunderstandings in this article. For instance:

> Your phone will run your images through NeuralHash, and compare to the list of forbidden hash codes. If there’s a match, some data will be uploaded to Apple’s servers when you upload the image.

Your phone doesn’t know whether there is a match or not. There is no “if match then upload”. The safety voucher is attached to every iCloud upload, not just the matches.

This is why Apple can’t just flip a setting and scan all your images regardless of whether you add them to iCloud or not. If they wanted to run this against all your images, they’d have to either upload all your images to iCloud (easy to spot; difficult for them to do without consent) or change the way this mechanism works (not “just flipping a setting”; if they wanted to scan all your images, then why build it this way in the first place?).

Re:A Screeching Voice of the Minority by diebeforei485 on Sunday August 29, 2021 @10:28PM (#28352301)
NCMEC is a government entity[1] with unique law enforcement powers.

1. https://cases.justia.com/federal/appellate-courts/ca10/14-32...

Re:A Screeching Voice of the Minority by robertoandred on Sunday August 29, 2021 @10:47PM (#28352385)
As your link states, its “law enforcement powers” are basically that it’s allowed to handle CSAM. NCMEC isn’t going to arrest you and charge you with a crime.
Re:A Screeching Voice of the Minority by diebeforei485 on Monday August 30, 2021 @12:28AM (#28352818)
This is a distinction without a difference, because the FBI, US Marshals, and others have agents who work full-time only with NCMEC, literally in the same office building.

> Representatives of multiple law enforcement agencies have offices in the NCMEC building, including the FBI, Department of Homeland Security, U.S. Marshals, U.S. Postal Inspection Service ...

Re:A Screeching Voice of the Minority by jrm4 on Sunday August 29, 2021 @10:15PM (#28352250)
No point you have made here suggests to me that we should worry or fight any less.
Re:A Screeching Voice of the Minority by dragonwriter on Sunday August 29, 2021 @10:33PM (#28352325)
> Apple does not report you to law enforcement

Technically, but not substantively, true since they report to the NCMEC, a government-funded government-established “private nonprofit” that is delegated a whole bunch of jobs for government, including gathering info on CSAM and distributing it to law enforcement for DoJ and processing child return/access requests under the Hague Convention on the Civil Aspects of International Child Abduction for the Department of State.

Re:A Screeching Voice of the Minority by breput on Sunday August 29, 2021 @10:22PM (#28352278)
> Apple does not report you to law enforcement, as this article claims. The article also ignores human review.

They do report you to a private organization who is primarily funded from the US Government and has zero interest in not passing along any information about potential child abusers.

If you believe Apple, there will be a human review element. What sort of people would go after this kind of job? I can't imagine. And this group will also have a huge incentive to err on the side of reporting any potential abuse content.

Edit: A legitimate, almost definitely "wants to the the right thing" private organization in the US. Have we heard about who gets notified in other jurisdictions?

Re:A Screeching Voice of the Minority by robertoandred on Sunday August 29, 2021 @10:35PM (#28352332)
There are human reviewers at Google, Facebook, and every other organization that has to moderate content. Not a novel idea.

And why would the NCMEC give law enforcement info about people they know are innocent?

Re:A Screeching Voice of the Minority by breput on Sunday August 29, 2021 @10:53PM (#28352411)
> There are human reviewers at Google, Facebook, and every other organization that has to moderate content. Not a novel idea.

For unencrypted content uploaded to their servers. That makes it a "Them Problem". Apple's approach is to scan before it is uploaded (and like the article says, "for now" - this can change with only a configuration change for all we know). And this could be a per-jurisdiction option and again, no one would know.

You have a point that this is not completely novel problem but do we have actual data on the number of real vs. false positives on the "everyone but Apple" group? Matthew Green probably would know but he doesn't[0].

[0] https://twitter.com/matthew_d_green/status/14283829528580833...

Re:A Screeching Voice of the Minority by breput on Sunday August 29, 2021 @11:07PM (#28352470)
There is an website[0] set up already to show to show how easy it is to find collisions with a photo of a beagle.

The left side photos are all apparently kitten photos but what if it was a photo of the Nirvana baby and, as a human reviewer, you had no access to the right side photo because it was just a hash in an anonymous database?

[0] https://thishashcollisionisnotporn.com/

Re:A Screeching Voice of the Minority by judge2020 on Monday August 30, 2021 @12:21AM (#28352787)
The Nirvana baby, as with many non-sexual pictures of naked babies, isn't considered CSAM and thus wouldn't be flagged. Even if it was, NCMEC reviewers (and Apple reviewers) almost certainly view the original CSAM next to the new photo when they receive potential re-circulations of the photo, if their task is indeed to verify the authenticity of a match. If reviewers had to make a CSAM judgement call on every incoming image, it'd be an extremely brittle system.
Re:A Screeching Voice of the Minority by robertoandred on Sunday August 29, 2021 @11:09PM (#28352481)
No one would know? iOS is constantly analyzed by people around the world for security vulnerabilities, strange behavior, etc. Why would this be different?
Re:A Screeching Voice of the Minority by mastazi on Sunday August 29, 2021 @10:56PM (#28352423)
Oh well if there are human reviewers then we can be sure there will be no abuse.

After all, Youtube copyright strikes have never been abused thanks to the fact that there are human reviewers.

Also, no app has ever been incorrectly removed from the Apple App Store, for the same reason that there are human reviewers.

This is thanks to the fact that human reviewers never make mistakes, unlike the rest of humans.

What could go wrong if we adopt the same system for something that could potentially result in a criminal investigation?

Re:A Screeching Voice of the Minority by robertoandred on Sunday August 29, 2021 @11:14PM (#28352501)
So your concern is that the automatic review fails, Apple’s human review fails, the NCMEC’s human review fails, and police go after you?
Re:A Screeching Voice of the Minority by mastazi on Sunday August 29, 2021 @11:22PM (#28352532)
My concern is that those mechanisms that regularly fail in other domains, as we have seen time and time again in recent years, would also fail in this case.

Are you able to explain why this specific case would be different?

Re:A Screeching Voice of the Minority by breput on Sunday August 29, 2021 @11:13PM (#28352496)
Humans are the cause and solution to every problem.
Re:A Screeching Voice of the Minority by jcims on Sunday August 29, 2021 @10:12PM (#28352236)
What do you think the public reception would’ve been if this technology had been available last year, and multiple jurisdictions published hashes of images from the riots at the capitol?

Or maybe, more directly, what do you think Apple employees reviewing these hits would do if those types of images started showing up in the triage list.

Re:A Screeching Voice of the Minority by robertoandred on Sunday August 29, 2021 @10:16PM (#28352253)
What exactly do you think publishing hashes of Jan 6 pics would achieve?

The photographers posted them publicly on Facebook and Twitter. That’s how we have them in the first place.

The problem wasn’t knowing who took the photos, it was knowing who was in the photos. And that needs facial detection, which this system can’t do.

Re:A Screeching Voice of the Minority by raxxorrax on Monday August 30, 2021 @07:40AM (#28354636)
You can quickly build relational graphs if you know which devices contain media that shares hashes. Sure, theoretical danger and not how this is implemented as hashes are just compared locally. This is different from accessing peoples contact lists they upload anyway because you want to group people in information bubbles that not necessarily correspond with real life contacts. This is very valuable info, isn't Google trying something similar?
Re:A Screeching Voice of the Minority by robertoandred on Monday August 30, 2021 @12:51PM (#28357742)
Hmm? Again, who took the photo isn't a secret. They happily posted them publicly.
Re:A Screeching Voice of the Minority by jcims on Sunday August 29, 2021 @11:35PM (#28352586)
It would achieve exactly what the system is designed to do, mine personal devices for photos that authorities are aware of. Just because a lot of people were sloppy doesn’t mean every person was.

However, my primary point is that there is no possibility of a technical control over the scope of the program. It’s a policy decision and is subject to explicit expansion or collusion/parallel construction.

Re:A Screeching Voice of the Minority by robertoandred on Monday August 30, 2021 @12:52PM (#28357766)
Are you referring to non-sloppy people who didn't post their pictures? In that case, their pictures couldn't be found anyway.