Re:Stability AI releases DeepFloyd IF, a powerful text-to-im...
by runnerup on Friday April 28, 2023 @01:37PM
(#35744550)
AFAIK, converting an image to a text summary isn't really a thing by itself. The related work would be "visual reasoning" which is the ability to ask things about the image in natural language and get responses back also in natural language.
I believe the current SOTA test for NLVR is VQAv2[0] or GQA[1].
I believe the current SOTA test for NLVR is VQAv2[0] or GQA[1].
0: https://visualqa.org/ 1: https://arxiv.org/pdf/1902.09506.pdf