Re:Laion Took Down Its Datasets After Discovery of Child Sex...
by orbital-decay on Wednesday December 20, 2023 @10:03AM
(#38709402)
It's useful because it includes most of the web. In enormous datasets like this, introspection and filtering is done with statistical/ML techniques. This was done with both LAION (obviously not enough to filter CSAM out) and the models trained on it - statistical analysis, 3rd party model classification and captioning, aesthetic scores, perceptual hashes etc. Only the filtered part of the dataset makes it into the actual training set, as LAION has notoriously poor quality.
[ Parent
| on HN ]
There are no comments on this comment yet.