News for hackers. Stuff that matters.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by 127361 on Wednesday December 20, 2023 @09:23AM (#38708991)
I think, over a dataset of nearly 6 billion images, it's just impossible to ensure that it contains no child pornography.

Like trying to ensure all my kitchen surfaces are 100% free of germs. Not possible, or the amount of effort and disruption caused by the cleaning will make it impossible to get on with my life. Nasty stuff exists out there. We don't want too much of it, though. That's my opinion about it.

Re:Laion Took Down Its Datasets After Discovery of Child Sex... by jerpint on Wednesday December 20, 2023 @09:27AM (#38709020)
You have to ask yourself not “how impossible” it is , rather how much effort was put into mitigating this. The answer is probably a nominal amount but obviously not enough
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by sp332 on Wednesday December 20, 2023 @10:17AM (#38709562)
The paper says that almost 500 of these were identified by MD5. That indicates that about 0 effort was put into mitigation.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by f38zf5vdt on Wednesday December 20, 2023 @12:34PM (#38711215)
md5 hashes are not a reliable indication of anything, since producing images that have collisions can be done in realtime.

https://www.exploit-db.com/docs/english/46047-md5-collision-...

Re:Laion Took Down Its Datasets After Discovery of Child Sex... by sp332 on Wednesday December 20, 2023 @04:56PM (#38714169)
That's if you have control of both images. With a given MD5 hash, you can't make another file with that hash.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by f38zf5vdt on Wednesday December 20, 2023 @10:59PM (#38716843)
Still not an argument for ever using them as reliable evidence. You have to trust whoever made the original hash to not have generated it with a duplicate, innocuous image providing a collision. These hashes are not verifiable as they appear to be parts of secret databases, so you are trusting the authority of that database not to do something like make innocuous colliding images for the sake of violating your personal freedoms.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by n2d4 on Wednesday December 20, 2023 @11:53AM (#38710714)
How does that logic work? Unless your definition of "mitigation" is "modifying CSAM before including it in the dataset"?

Like, "identified by MD5" doesn't mean that they didn't attempt to remove images! A lot of CSAM out there is not yet on those lists, and a lot of it is being added as we speak, so if LAION-5B was filtered using one list of MD5 hashes, that doesn't mean it doesn't contain CSAM that's on a different list (or a newer version thereof).

And you have this problem no matter whether LAION actually took any steps to remove CSAM before publishing the dataset or not. Unfortunately, any sufficiently large such dataset will contain some bad content (how we should deal with this is a different question that I sadly don't have an answer for).

Re:Laion Took Down Its Datasets After Discovery of Child Sex... by sp332 on Wednesday December 20, 2023 @04:30PM (#38713897)
If it's all new, I guess that's one thing. But in general, if LAION wanted to know if this content was in the collection, they could have queried the same database. Some new heuristics turned up others, but I mean the basic search could have been done.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by morkalork on Wednesday December 20, 2023 @10:22AM (#38709626)
So why all the worry about re-uploading a clean dataset because someone "could do a diff" to find the bad images? Could they not use the same md5 search to find the same?
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by doubloon on Wednesday December 20, 2023 @10:40AM (#38709835)
i guess the argument is that these images were a needle in a haystack and now you have given the public a supermagnet to go find it.

like right now, if someone tries to download old laion and find those images manually, it would probably take them a very very long time. if they had the diff, they would find them in a few minutes.

i dont think its a good argument, but its an argument. the researchers found them without a diff so likely someone else can too. so theres not much reason to leave them in that i can tell.

Re:Laion Took Down Its Datasets After Discovery of Child Sex... by morkalork on Wednesday December 20, 2023 @10:45AM (#38709905)
Yes, I get that. But that's not what the researchers did. They used a database of know hashes. Can bad actors not do the same?
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by sp332 on Wednesday December 20, 2023 @11:59AM (#38710797)
I don't think it's easy to get access to the PhotoDNA database. And it would be a service that they query against, so they'd have an audit trail.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by dublinben on Wednesday December 20, 2023 @04:37PM (#38713972)
You're not allowed to have the MD5 hashes these researchers used to find these images, so it's not possible to reproduce this result. These hash databases and APIs are tightly controlled, and only law enforcement, major tech companies and top researchers are allowed to use them.
Re:Laion Took Down Its Datasets After Discovery of Child Sex... by echelon on Wednesday December 20, 2023 @09:35AM (#38709109)
I'll bet OpenAI and Google are also contaminated, but that we'll never know and it'll never be cleaned.

With open source efforts, we can eventually reach a state of public certification. It can be fully vetted, unlike closed source models.