Re:Nearest neighbor indexes for similarity search
by bguberfain on Thursday August 12, 2021 @08:14AM
(#28155238)
Thanks for sharing! I have a question: is there any option for sparse vectors (like tf-idf outputs)?
[ Parent
| on HN ]
Re:Nearest neighbor indexes for similarity search
by mumblemumble on Thursday August 12, 2021 @10:41AM
(#28156909)
nmslib (https://github.com/nmslib/nmslib) supports sparse vectors for some of its spaces. It has fewer indexing methods than faiss, though.
https://github.com/nmslib/nmslib/blob/master/manual/spaces.m...
Re:Nearest neighbor indexes for similarity search
by jamesbriggs on Thursday August 12, 2021 @08:30AM
(#28155390)
Welcome! Unfortunately faiss doesn't support sparse vectors. If you're using sparse vectors I would either not use faiss (there are better options like Elasticsearch) - or convert them into dense for use with faiss