News for hackers. Stuff that matters.

A comment on Teens can proactively block their nude images from Instagram, OnlyFans.

Re:Teens can proactively block their nude images from Instag... by _manifold on Monday February 27, 2023 @04:40PM (#34962260)
>To use Take It Down, anyone—minors, parents, concerned parties, or adults concerned about their own underage images being posted online—can anonymously access the platform on NCMEC’s site. Take It Down will then generate a hash that represents images or videos reported by users as sexualizing minors, including images with nudity, partial nudity, or sexualized poses. From there, any online platform that has partnered with the initiative will automatically block uploads or remove content matching that hash.

This sounds impressive if you don't know how file hashing works. If a malicious actor wants to get around this, all they would have to do is change a single pixel and/or re-export as a different format.

[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by mikestew on Monday February 27, 2023 @04:48PM (#34962353)
all they would have to do is change a single pixel and/or re-export as a different format

This sounds plausible if you don't know how perceptual hashing works:

https://en.wikipedia.org/wiki/Perceptual_hashing

[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by mrguyorama on Monday February 27, 2023 @04:52PM (#34962411)
Your own links talks about how perceptual hashing hasn't been proven to be robust enough for this use case, and also introduces a new problem: Hash collisions, such that you can generate images that hash to the same perceptual hash as an illicit image.
[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by mikestew on Monday February 27, 2023 @05:05PM (#34962589)
Robust or not, it's a little more nuanced than a file hash that goes out the window because a single pixel changed, as implied by GP.
[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by _manifold on Monday February 27, 2023 @04:52PM (#34962414)
Yes, I did some more research on this as well. Apparently perceptual hashing is also susceptible to some pretty simple attacks:

https://arxiv.org/pdf/2111.06628.pdf

[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by AdamJacobMuller on Monday February 27, 2023 @04:48PM (#34962355)
Not necessarily. There are much newer technologies than simple hashes of files now, which are effectively content-aware image hashing algorithms which are highly resistant to manipulation techniques (re-encoding, resizing, even things like rotation/blur) they are of course tunable algorithms which the more you want to catch the more false positive rate there is but you can already today do much better than simple file hash.

Look at https://www.microsoft.com/en-us/photodna and https://openbase.com/python/ImageHash/documentation

[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by _manifold on Monday February 27, 2023 @05:32PM (#34962935)
I think it's definitely more useful, especially long term, in a more controlled system where the government agency that is handling the actual CSAM is simply submitting hashes of the content the company (Microsoft, Apple, or whoever else) to add to their database with which they can use to flag/review suspicious content.

However, the system described in the article is open to the public, and simultaneously privacy/anonymity oriented. I see this as a double-edged sword. While it does protect the identity of legitimate users, that also opens it up to nefarious actors flooding the system with images/videos taken from legitimate content creators on OnlyFans other sites, potentially getting those creators' content flagged/removed. Even if this simply triggers a manual review, you could feasibly spam the system with so many that it grinds to a halt.

[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by zamnos on Monday February 27, 2023 @06:59PM (#34963848)
Good thing it's open source, now I know how much I need to change the image in order for the hash to change!
[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by SpaghettiCthulu on Tuesday February 28, 2023 @11:01AM (#34970760)
People have found ways to bypass and reverse (albeit with reduced quality) Photodna

Edit: here's a source https://www.anishathalye.com/2021/12/20/inverting-photodna/

[ Parent | on HN ]
Re:Teens can proactively block their nude images from Instag... by cyanydeez on Monday February 27, 2023 @06:53PM (#34963797)
Perceptual hashing exists.
[ Parent | on HN ]