Child safety org launches AI model trained on real child sex abuse images

Re:Child safety org launches AI model trained on real child ... by chockablocker on Thursday November 21, 2024 @12:55PM (#42206823)

Now that such a model exists, I think we can expect lobbying for making this mandatory. For the children...

Once adopted this will lead to an increase in randomly locked out accounts due to model false positives, because looking for something very rare will lead to most items flagged being false positives (Bayes statistics etc.).

This blog had a few interesting articles on the limitations of these technologies https://www.hackerfactor.com/blog/index.php?/archives/971-FB... While this is comparing the currently used hash based approaches a classification model will have similar problems.

[ Parent | on HN ]

Re:Child safety org launches AI model trained on real child ... by rbanffy on Friday November 22, 2024 @08:13AM (#42213566)

> Once adopted this will lead to an increase in randomly locked out accounts due to model false positives

I would assume the model was also trained on negatives that look like CSAM but aren’t.

[ Parent | on HN ]