Re:Laion Took Down Its Datasets After Discovery of Child Sex...
by billyhoffman on Wednesday December 20, 2023 @09:51AM
(#38709261)
> LAION datasets (more than 5.85 billion entries) are sourced from the freely available Common Crawl web index and offer only links to content on the public web, with no images. We developed and published our own rigorous filters to detect and remove illegal content from LAION datasets before releasing them.
This makes me wonder if CommonCrawl WARC dumps themselves contain CSAM.
Re:Laion Took Down Its Datasets After Discovery of Child Sex...
by SirWart on Wednesday December 20, 2023 @10:17AM
(#38709571)
As noted in the quote, the CommonCrawl WARC files don’t contain images themselves, LAION used those files to find img tags and downloaded them themselves
This makes me wonder if CommonCrawl WARC dumps themselves contain CSAM.