Re:Embeddings, Vectors, and Arithmetic
by two_in_one on Friday December 15, 2023 @07:44PM
(#38660674)
isn't that how translation works in tranformers? encoder produces embedding then decoder generates the sentence. do it again with reverse translation and you get your text back in original language. combining two sentences can be done by using model for summary. making a cross-breed of two sentences is a different problem.
I also recommend a video by Yannic Kilcher [2], explaining the paper.
[1] https://arxiv.org/abs/2310.06816
[2] https://www.youtube.com/watch?v=FY5j3P9tCeA