Re:Nearest neighbor indexes for similarity search
by jamesbriggs on Thursday August 12, 2021 @08:09AM
(#28155198)
Hey all, I'm the author - feel free to ask me any questions about the article!
[ Parent
| on HN ]
Re:Nearest neighbor indexes for similarity search
by lootsauce on Thursday August 12, 2021 @07:35PM
(#28163151)
Are there any approaches to this problem that are distributed perhaps could take advantage of serverless functions type implementation?
Re:Nearest neighbor indexes for similarity search
by bguberfain on Thursday August 12, 2021 @08:14AM
(#28155238)
Thanks for sharing! I have a question: is there any option for sparse vectors (like tf-idf outputs)?
Re:Nearest neighbor indexes for similarity search
by mumblemumble on Thursday August 12, 2021 @10:41AM
(#28156909)
nmslib (https://github.com/nmslib/nmslib) supports sparse vectors for some of its spaces. It has fewer indexing methods than faiss, though.
https://github.com/nmslib/nmslib/blob/master/manual/spaces.m...
Re:Nearest neighbor indexes for similarity search
by jamesbriggs on Thursday August 12, 2021 @08:30AM
(#28155390)
Welcome! Unfortunately faiss doesn't support sparse vectors. If you're using sparse vectors I would either not use faiss (there are better options like Elasticsearch) - or convert them into dense for use with faiss