News for hackers. Stuff that matters.
Re:Nearest neighbor indexes for similarity search by jamesbriggs on Thursday August 12, 2021 @08:09AM (#28155198)
Hey all, I'm the author - feel free to ask me any questions about the article!
Re:Nearest neighbor indexes for similarity search by lootsauce on Thursday August 12, 2021 @07:35PM (#28163151)
Are there any approaches to this problem that are distributed perhaps could take advantage of serverless functions type implementation?
Re:Nearest neighbor indexes for similarity search by bguberfain on Thursday August 12, 2021 @08:14AM (#28155238)
Thanks for sharing! I have a question: is there any option for sparse vectors (like tf-idf outputs)?
Re:Nearest neighbor indexes for similarity search by mumblemumble on Thursday August 12, 2021 @10:41AM (#28156909)
nmslib (https://github.com/nmslib/nmslib) supports sparse vectors for some of its spaces. It has fewer indexing methods than faiss, though.

https://github.com/nmslib/nmslib/blob/master/manual/spaces.m...

Re:Nearest neighbor indexes for similarity search by jamesbriggs on Thursday August 12, 2021 @08:30AM (#28155390)
Welcome! Unfortunately faiss doesn't support sparse vectors. If you're using sparse vectors I would either not use faiss (there are better options like Elasticsearch) - or convert them into dense for use with faiss