Re:Laion-5B: A new era of open large-scale multi-modal datasets
by GaggiX on Monday December 12, 2022 @03:26PM
(#33959772)
It is not believable that someone would pay humans to label 400mln or 5bln images/samples to train a model on them, but I guess if you argument is "everything is possible" then gotcha
[ Parent
| on HN ]
Re:Laion-5B: A new era of open large-scale multi-modal datasets
by satvikpendem on Monday December 12, 2022 @04:02PM
(#33960228)
If it's done in a reCAPTCHA like way, it can be done fairly efficiently and for cheap. In fact Scale AI does just this, they do manual labor operations such as captioning images, as an API. Here's their product for image labeling: https://scale.com/rapid.
Unstable Diffusion is also doing their captioning like how I mentioned, with groups of volunteers as well as hired individuals.
Re:Laion-5B: A new era of open large-scale multi-modal datasets
by GaggiX on Monday December 12, 2022 @04:27PM
(#33960604)
Scale seems to do, for example, image classification but not captioning as it would be hard to compare the results with others people to verify the quality (when you have a discrete number of classes is really straightforward), also can you report where you read about the Unstable Diffusion plan for manually labeling image datasets? I want to dig deeper
Re:Laion-5B: A new era of open large-scale multi-modal datasets
by satvikpendem on Monday December 12, 2022 @04:32PM
(#33960668)
From their Reddit post about this: https://old.reddit.com/r/StableDiffusion/comments/zhg18s/uns...
Re:Laion-5B: A new era of open large-scale multi-modal datasets
by GaggiX on Monday December 12, 2022 @04:40PM
(#33960822)
> We are releasing Unstable PhotoReal v0.5 trained on thousands of tirelessly hand-captioned images
They seem to have created a much smaller dataset than LAION's, it would not work to train a generative model on such a small amount of images (obviously the images here do not have a single domain).
Re:Laion-5B: A new era of open large-scale multi-modal datasets
by devmor on Monday December 12, 2022 @03:50PM
(#33960085)
You seem to be confusing "possibility" with your personal opinion on what you think would be done by others.
Re:Laion-5B: A new era of open large-scale multi-modal datasets
by GaggiX on Monday December 12, 2022 @04:05PM
(#33960254)
As a human being I know human limitations, explicitly labeling 400mln/5bln images for a particular task seems absurd to me, but if you think it is realistically possible perhaps you can give an example.