Re:OpenArt: “Pinterest” for Dalle-2 images and prompts
by krisoft on Thursday August 25, 2022 @03:24AM
(#32590676)
> I'm not sure if Dalle-2 embeds any metadata, but openAI also has this CLIP model https://openai.com/blog/clip/ that lets you get embeddings.
Hah! Same word, two totally different meaning.
Metadata embedding: store extra information in non-visible fields in the file. For example some phones save the gps location where the picture was made in the image.
CLIP embedding: a vector which describes the semantic content of an image. It is the output of an AI model which maps the image into a semantic space (aka embeds the image in said space.) This vectorial description then typically can be used for image content classification or textual label generation.
Hah! Same word, two totally different meaning.
Metadata embedding: store extra information in non-visible fields in the file. For example some phones save the gps location where the picture was made in the image.
CLIP embedding: a vector which describes the semantic content of an image. It is the output of an AI model which maps the image into a semantic space (aka embeds the image in said space.) This vectorial description then typically can be used for image content classification or textual label generation.