Re:Embeddings Are Underrated
by luke-stanley on Monday May 12, 2025 @02:01PM
(#43965837)
"starting from an embedding and working backwards to generate a piece of text that is semantically close by?"
Apparently this is called embedding inversion and Universal Zero-shot Embedding Inversion https://arxiv.org/abs/2504.00147
Going incrementally closer and closer to the target with some means to vary seems to be the most general way, there are lots of ways to be more optimal though. Image diffusion with CLIP embeddings and such is kinda related too.
[ Parent
| on HN ]
Re:Embeddings Are Underrated
by luke-stanley on Wednesday May 14, 2025 @07:30AM
(#43983210)
I meant to say: Apparently this is called "embedding inversion", and that "Universal Zero-shot Embedding Inversion" is a related paper that covers a lot of the basics.
Recently I learned that a ArXiv RAG agent by ArXiv Labs is a really cool way for people wanting to find out about research:
https://www.alphaxiv.org/assistant
Though I had ran into "inversion" before, the AlphaXiv Assistant introduced me to "embedding inversion".