News for hackers. Stuff that matters.
Re:The Theoretical Limitations of Embedding-Based Retrieval by yorwba on Saturday August 30, 2025 @02:55AM (#45072485)
When you truncate Matryoshka embeddings, you get the storage benefits of low-dimensional vectors with the limited expressiveness of low-dimensional vectors. Usually, what people look for in sparse vectors is to combine the storage benefits of low-dimensional vectors with the expressiveness of high-dimensional vectors. For that, you need the non-zero dimensions to be different for different vectors.

There are no comments on this comment yet.