A catalog of naturally occurring images whose Apple NeuralHash is identical

Re:A catalog of naturally occurring images whose Apple Neura... by yeldarb on Wednesday August 25, 2021 @07:31AM (#28300252)

> allows the producers and distributors of CSAM material to ensure that nearly all of the next generation of CSAM will suffer from hash collisions with perfectly innocent images

That’s a really interesting attack vector I hadn’t seen mentioned previously.

Most people are talking about the potential for adversarial images to be sent to users. If they were instead injected into the database itself (either by poisoning real CSAM or social engineering) that would have far wider ramifications.

I wonder what the most widely-saved pornographic images are across iCloud users.

If actual CSAM were perturbed to match the hash of, say, images from the celebrity nude leak a few years back and added to the database then thousands of users could be sent to “human review”. Since the images are actually explicit how would the human reviewers know not to flag them to authorities?

[ Parent | on HN ]

Re:A catalog of naturally occurring images whose Apple Neura... by theshrike79 on Wednesday August 25, 2021 @08:37AM (#28300847)

Because they're not CSAM?

People don't seem to grasp what kind of images end up in the CSAM databases. They are most definitely not "leaked celebrity nude selfie" level stuff.

Think of the most vile sexual thing you could do to a child and then times that by two and halve the child's age in your mind. That's the shit that gets in there.

It's not something even 4chan weebaboos share. It's stuff that makes Liveleak regulars go "ewwwww, gross".

[ Parent | on HN ]

Re:A catalog of naturally occurring images whose Apple Neura... by saithound on Wednesday August 25, 2021 @08:49AM (#28300965)

The issue is not that a celebrity photo might get into a CSAM database. It's that a true CSAM photo, which has been modified to have the same hash as a "leaked celebrity nude selfie", will probably get into a CSAM database.

[ Parent | on HN ]

Re:A catalog of naturally occurring images whose Apple Neura... by theshrike79 on Wednesday August 25, 2021 @12:31PM (#28303664)

The CSAM database is not generated by an AI. Actual people hand-pick the worst images to include in the list.

[ Parent | on HN ]

Re:A catalog of naturally occurring images whose Apple Neura... by yeldarb on Wednesday August 25, 2021 @09:58AM (#28301762)

How is the human reviewer expected to make that judgement call? They’re not allowed to see the original to compare with for obvious reasons.

[ Parent | on HN ]

Re:A catalog of naturally occurring images whose Apple Neura... by theshrike79 on Wednesday August 25, 2021 @12:29PM (#28303641)

They see a "visual derivative" of the original.

I think they can tell the difference between a naked celebrity and a molested child.

[ Parent | on HN ]