News for hackers. Stuff that matters.
Re:Find anything fast with Google's vector search technology by m3at on Tuesday December 14, 2021 @06:34PM (#29559665)
Not the author, but at work we've had in the hundreds of millions. Faiss can certainly scale.

If you do have a tiny index and want to try Google's version of vector search (as an alternative to Faiss), you can easily run ScaNN locally [1] (linked in the article, that's the underlying tech). On small scale I had better perf with ScaNN

[1] https://github.com/google-research/google-research/tree/mast...

Re:Find anything fast with Google's vector search technology by freediver on Tuesday December 14, 2021 @06:57PM (#29559910)
Thanks for mentioning it. Just tried it and it seems to be faster than Faiss indeed on smaller scale searches.
Re:Find anything fast with Google's vector search technology by leobg on Wednesday December 15, 2021 @04:01AM (#29563576)
There's also hnswlib[1], which has supposedly lower memory requirements and allows for adding new vectors to an existing index.

[1]: https://github.com/nmslib/hnswlib/