News for hackers. Stuff that matters.
Re:The Theoretical Limitations of Embedding-Based Retrieval by 3abiton on Friday August 29, 2025 @09:33PM (#45071166)
Doesn't PCA compress the embeddings in this case, ie reduce the accuracy? It's similar to quantization.
Re:The Theoretical Limitations of Embedding-Based Retrieval by CuriouslyC on Friday August 29, 2025 @10:55PM (#45071547)
Component analysis doesn't fundamentally reduce information, it just rotates it into a more informative basis. People usually drop vectors using the eigenvalues to do dimensionality reduction, but you don't have to do that.