News for hackers. Stuff that matters.

A comment on Laion-5B: A new era of open large-scale multi-modal datasets. Parent comment

Re:Laion-5B: A new era of open large-scale multi-modal datasets by satvikpendem on Monday December 12, 2022 @04:02PM (#33960228)
If it's done in a reCAPTCHA like way, it can be done fairly efficiently and for cheap. In fact Scale AI does just this, they do manual labor operations such as captioning images, as an API. Here's their product for image labeling: https://scale.com/rapid.

Unstable Diffusion is also doing their captioning like how I mentioned, with groups of volunteers as well as hired individuals.

[ Parent | on HN ]
Re:Laion-5B: A new era of open large-scale multi-modal datasets by GaggiX on Monday December 12, 2022 @04:27PM (#33960604)
Scale seems to do, for example, image classification but not captioning as it would be hard to compare the results with others people to verify the quality (when you have a discrete number of classes is really straightforward), also can you report where you read about the Unstable Diffusion plan for manually labeling image datasets? I want to dig deeper
[ Parent | on HN ]
Re:Laion-5B: A new era of open large-scale multi-modal datasets by satvikpendem on Monday December 12, 2022 @04:32PM (#33960668)
From their Reddit post about this: https://old.reddit.com/r/StableDiffusion/comments/zhg18s/uns...
[ Parent | on HN ]
Re:Laion-5B: A new era of open large-scale multi-modal datasets by GaggiX on Monday December 12, 2022 @04:40PM (#33960822)
> We are releasing Unstable PhotoReal v0.5 trained on thousands of tirelessly hand-captioned images

They seem to have created a much smaller dataset than LAION's, it would not work to train a generative model on such a small amount of images (obviously the images here do not have a single domain).

[ Parent | on HN ]