News for hackers. Stuff that matters.
Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by onetimeusename on Thursday August 05, 2021 @12:26AM (#28069857)
I agree, I would add that people have generated legal images that match the hashes.

So I want to ask what happens if you have a photo that is falsely identified as one in question and then an automated mechanism flags you and reports you to the FBI without you even knowing. Can they access your phone at that point to investigate? Would they come to your office and ask about it? Would that be enough evidence to request a wiretap or warrant? Would they alert your neighbors? How do you clear your name after that happens?

edits: yes, the hash database is downloaded to the phone and matches are checked on your phone.

Another point is that these photos used to generate the fingerprints are really legal black holes that the public is not allowed to inspect I assume. No one wants to be involved in looking at them, no one wants to be known as someone who looks at them. It could even be legally dangerous requesting to find out what has been put into the image database I assume.

Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by SilverRed on Thursday August 05, 2021 @01:21AM (#28070171)
>I would add that people have generated legal images that match the hashes.

That seems like a realistic attack. Since the hash list is public (has to be for client side scanning), you could likely set your computer to grind out a matching image hash but of some meme which you then distribute.

Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by shuckles on Thursday August 05, 2021 @11:19AM (#28074953)
The NCMEC hash list is private, and adversarial attacks require running gradient descent and being able to generate a hash value for arbitrary input.
Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by josephcsible on Thursday August 05, 2021 @07:07PM (#28081241)
At least one of these two things must be true: either Apple is going to upload hashes of every image on your device to someone else's server, or the database of hashes will be available somehow to your device.
Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by josephcsible on Saturday August 07, 2021 @11:42PM (#28104042)
Turns out there's a third option I wasn't thinking about: private set intersection.

https://news.ycombinator.com/item?id=28097683

Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by shrimpx on Thursday August 05, 2021 @09:16PM (#28082163)
Is it possible to narrow in on a hash using gradient descent? You can correlate distance between inputs to distance between hashes somehow?
Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by shrimpx on Friday August 06, 2021 @08:46PM (#28094548)
Replying to my own question since I can’t edit anymore: it turns out “perceptual hashing,” which I didn’t know much about, has exactly this property, that small changes in the input result in small changes in the output.
Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by google234123 on Thursday August 05, 2021 @01:47AM (#28070287)
Might be hard if they use a huge hash.
Re:Apple enabling client-side CSAM scanning on iPhone tomorrow by SilverRed on Thursday August 05, 2021 @02:18AM (#28070459)
One thing to note is these are not typical cryptographic hashes because they have to be able to find recompressed/cropped/edited versions as well. Perhaps a hash is not an accurate way to describe it.

There have been a number of cases where people have found ways to trick CV programs in to seeing something that no human would ever see. If you were sufficiently malicious I imagine it would be possible to do with this system as well.