News for hackers. Stuff that matters.

A comment on A Developer Accidentally Found CSAM in AI Data. Google Banned Him for It. Parent comment

Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by jsheard on Thursday December 11, 2025 @11:44AM (#46233688)
It's a delicate subject but not an unprecedented one. Automatic detection of already known CSAM images (as opposed to heuristic detection of unknown images) has been around for much longer than AI, and for that service to exist someone has to handle the actual CSAM before it's reduced to a perceptual hash in a database.

Maybe AI-based detection is more ethically fraught since you'd have to stockpile CSAM to train on, rather than immediately hashing it then destroying it.

[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by tcfhgj on Thursday December 11, 2025 @12:14PM (#46234095)
> Maybe AI detection is more ethically fraught since you'd need to keep hold of the CSAM until the next training run,

why?

the damage is already done

[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by tremon on Thursday December 11, 2025 @12:39PM (#46234470)
Why would you think that? Every distribution, every view is adding damage, even if the original victim doesn't know (or even would rather not know) about it.
[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by jjk166 on Thursday December 11, 2025 @12:52PM (#46234636)
I don't think AI training on a dataset counts as a view in this context. The concern is predators getting off on what they've done, not developing tools to stop them.
[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by pseudalopex on Thursday December 11, 2025 @03:50PM (#46236960)
Debating what counts as a view is irrelevant. Some child pornography subjects feel violated by any storage or use of their images. Government officials store and use them regardless.
[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by tcfhgj on Thursday December 11, 2025 @01:00PM (#46234725)
I don't think it's how it works.
[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by pseudalopex on Thursday December 11, 2025 @03:51PM (#46236968)
Some victims feel this way. Some do not.
[ Parent | on HN ]
Re:A Developer Accidentally Found CSAM in AI Data. Google Ba... by giantg2 on Friday December 12, 2025 @08:24AM (#46243892)
I would think there's more possibility of it leaking or being abused in a giant stockpile. Undoubtedly, those training sets would be commercialized in some way, potentially causing some to see that as adding insult to injury.
[ Parent | on HN ]