News for hackers. Stuff that matters.
Re:Are we at peak vector database? by brookst on Friday January 26, 2024 @09:24AM (#39142903)
I’m fascinated by embeddings translations and compatible embeddings with different numbers of dimensions. Can you share more about your work / findings?
Re:Are we at peak vector database? by sdenton4 on Friday January 26, 2024 @10:52AM (#39144033)
I mean, the simplest answer is a matmul... Given embedding x, y, find M such that Mx ~= y. Easy to train so long as you've got access to both models to compute embedding over whatever you're interested in...

(easy to extend to two layers mlp as needed. maybe ensure that x and y are zero mean and unit length to make training the matmul a bit easier.)