Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by dsign on Wednesday August 18, 2021 @05:25AM
(#28219132)
So, these adversarial collisions are the images that I need to send to my enemies so that they go to prison when they upload those images to iCloud? It seems trivially easy to exploit.
[ Parent
| on HN ]
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by xucheng on Wednesday August 18, 2021 @05:35AM
(#28219166)
You can technically hide an adversarial collision inside a complete legit normal image. It won’t be seen by human eyes but it will trigger a detection. In addition, you can do the complete opposite by perturbing a CSAM to output complete different hash to circumvent the detection. All of these vulnerabilities are well known for perceptual hash.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by SV_BubbleTime on Wednesday August 18, 2021 @07:43PM
(#28228637)
So right there seems to be an issue to me. It seems like if you were trading in CSAM, you would run CLEANER -all on anything and everything. Because you know someone has already written that as proof of concept here.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by sneak on Wednesday August 18, 2021 @07:52AM
(#28219957)
You can also just send your enemies CSAM, it is more effective at imprisoning them.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by eknkc on Wednesday August 18, 2021 @08:00AM
(#28220004)
They probably would not hold onto them and also now you have a paper trail of sending CSAM to people. But if you were to alter some innocent looking photos and send them to someone, they might store those.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by zepto on Wednesday August 18, 2021 @10:57AM
(#28221920)
Yes, but that won’t work since innocent looking photos won’t match the visual derivative.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by TechBro8615 on Wednesday August 18, 2021 @11:07PM
(#28229909)
That sounds like a good reason not to create a virtual SWATing vector then.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by UncleMeat on Wednesday August 18, 2021 @10:43AM
(#28221637)
No. Because, as documented in the published material, hits are also reviewed by humans.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by heavyset_go on Wednesday August 18, 2021 @02:08PM
(#28224965)
Downscaled derivative images are what are checked, and if the reviewer even suspects that the downscaled image contains sexual content of a minor, they're required to report it. At that point, it is the authorities who decide whether or not to continue to investigate and determine if the user possesses CSAM. That investigation alone can ruin lives.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by user-the-name on Wednesday August 18, 2021 @02:28PM
(#28225266)
The "downscaled" image 360x360. It's pretty easy to compare two images at that size to determine if they are the same. You're not going to end up investigated unless you actually have actual picture of child pornography. Also, not just one, the process doesn't even start until you have a fairly large number.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by Xamayon on Wednesday August 18, 2021 @04:15PM
(#28226491)
It's highly unlikely that the apple reviewer will have access to the actual image in the database, instead they will assess whether the blurry,b/w,etc modified thumbnail could possibly be illegal. Given the level of secrecy surrounding the contents of the DB, even the normal NCMEC reviewers may not have access to those for comparison. There are plenty of CG images, small legal models, or even images of erotic toys which could be used as the base image which would look very suspicious as a low quality thumbnail.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by user-the-name on Wednesday August 18, 2021 @07:49PM
(#28228684)
There will be someone along the line who will check that the image is, in fact, the actual listed image. Otherwise, there is no legal case to be made.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX
by heavyset_go on Wednesday August 18, 2021 @10:43PM
(#28229769)
> There will be someone along the line who will check that the image is, in fact, the actual listed image.
That someone will be law enforcement, and they will get a warrant for all of your electronic devices in order to determine if you actually have CSAM or not. It's literally their job to investigate whether crimes were committed or not. Those investigations alone can ruin lives, even more so if arrests are made based on the tips or suspicions.