News for hackers. Stuff that matters.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by breuleux on Thursday August 19, 2021 @02:02PM (#28237143)
The db is encrypted and uploaded to user devices. If each country gets a different db, the payload will be different in each country, which does not make sense if it's all supposed to be CSAM. So Apple would likely just say "these were mandated by the US government for US citizens," punting the ball in their court, unless they are forbidden to say so, in which case they'll say nothing, but we all know what it means. That's when you know you should change phones and stop using all cloud services, because obviously all cloud services scan for the same thing.

On the flip side, though, at least Apple will have given us a canary. And that's why I don't think Apple will be asked to add these hashes: if the governments don't want their citizens to know what's being scanned server side, pushing the equivalent data to clients would tip their hand. They might just write Apple off as a loss and rely on Google, Facebook, etc.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by sillysaurusx on Thursday August 19, 2021 @02:09PM (#28237222)
This isn’t true. The db is blinded. We have no way of knowing what’s in it.

It would be trivial to have the same payload on each device, and extract different answers using the matching server side db which varies by country.

Perhaps not trivial, but just short.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by breuleux on Thursday August 19, 2021 @03:06PM (#28237934)
I feel that it's the kind of scheme that requires too much cooperation from too many people and organizations with conflicting incentives. It's possible some countries would not want the hashes from certain other governments in the db at all. And then what? I may be wrong, but I also believe we can know how many hashes are in the db, which means that if it contains extra hashes from dozens of governments, it would become suspiciously large relative to how many CSAM images we know exist. Furthermore, in this scenario the db cannot be auditable, so the scheme falls apart as soon as some rogue judge decides to order an audit.

I honestly don't think Apple wants to deal with any of that crap and that they would rather silently can the system and do exactly what everybody else does than place themselves in the line of fire when their own unique trademark system is being abused.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by sillysaurusx on Thursday August 19, 2021 @03:23PM (#28238169)
Would they rather deal with the CCP shutting off iPhone sales in China? History has shown that the CCP is willing to do that if it comes down to it. (I remind you that at one time, Google was a primary search engine in China.)
Re:ImageNet contains naturally occurring Apple NeuralHash co... by azinman2 on Thursday August 19, 2021 @03:19PM (#28238095)
What do you mean blinded? It’s already been promised there will be a way to verify the hash db on your own device.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by sillysaurusx on Thursday August 19, 2021 @03:22PM (#28238144)
It’s blinded in the cryptographic sense. It’s a specific term. I would go into detail, but <reasons>.

Suffice to say, unless you provide proof, I am reasonably confident there’s no way to verify the hash db doesn’t contain extra hashes other than the CSAM hashes provided by the US government. But I’ve been wrong many times before.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by azinman2 on Thursday August 19, 2021 @03:32PM (#28238267)
Well first of all, it's not provided by the US government. It's a non-profit, and Apple has already said they're going to look for another db from another nation and only included hashes that are the union of the two to prevent exactly this kind of attack.

If what you mean by blinded is that you don't know what the source image is for the hash, that's true. Otherwise Apple would just be putting a database of child porn on everyone's phones. You gotta find some kind of balance here.

What do you mean you can't verify it doesn't contain extra hashes? Meaning that Apple will say here are the hashes in your phone, but secretly will have extra hashes they're not telling you about? Not only is this the kind of thing that security researchers will quickly find, you're assuming a very sinister set of features from Apple that they'll only tell you half the story. If that were the case, then why offer the hashes at all? It's an extremely cynical take.

The reality is all of the complaints about this system went from this specific implementation, and then as details get revealed, it's now all about the future hypothetical situations. I'm personally concerned about future regulations, but those regulations could/would exist independently of this specific system. Further, Dropbox, Facebook, Microsoft, Google, etc all have user data unencrypted on their servers and are also just as vulnerable to said legislation. If the argument is this is searching your device, well the current implementation is its only searching what would be uploaded to a server instead. If you suggest that could change to anything on your device due to legislation, wouldn't that happen anyway? And then what is Google going to do... not follow the same laws? Both companies would have to implement new architectures and systems for complying.

I'm generally concerned about the future of privacy, but I think people (including myself initially) have gone too far in losing their minds.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by conradev on Thursday August 19, 2021 @04:17PM (#28238821)
I would just read the document explaining how this works (see "Matching-Database Setup"): https://www.apple.com/child-safety/pdf/CSAM_Detection_Techni...

At no point is anyone besides Apple able to view any NeuralHash hashes from the CSAM database. You can verify the database is the same on all iPhones, but you are not able to look at any of the hashes.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by azinman2 on Thursday August 19, 2021 @05:53PM (#28239838)
Right, but perhaps I'm not understanding what the complaint is here.

Is the issue that you want to take a given photo that you believe the CCP or whomever is scanning for, compute a NeuralHash, and then see if that's in the db? Or are you wanting to see if your db is different from other phone's db's? Because I think the later is the one that most people are concerned about.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by int_19h on Thursday August 19, 2021 @05:06PM (#28239374)
It's a non-profit that is effectively maintained by the US government (funding, special legal status, interaction with government agencies etc).
Re:ImageNet contains naturally occurring Apple NeuralHash co... by azinman2 on Thursday August 19, 2021 @05:55PM (#28239846)
Having just read the CSAM summary pointed to by a child comment here, I know have a better understanding of what you meant by blinded. But I don't think that changes any of my points.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by IncRnd on Thursday August 19, 2021 @03:50PM (#28238495)
There are many functions to which cryptographic blinding is applied, but they each rely upon multiple parties to compute the function in question. In that way, the input and output are blinded to a single party.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by dhosek on Thursday August 19, 2021 @03:49PM (#28238472)
>That's when you know you should change phones

You'd have to switch to a dumb phone. Assuming you can find one that works on contemporary networks.