News for hackers. Stuff that matters.
Re:Introducing Notion AI by visarga on Wednesday November 16, 2022 @11:36AM (#33625961)
They could have used HuggingFace models to embed texts, put them in a vector search engine and serve results.

- models here: https://sbert.net/docs/pretrained_models.html

- fast vector search here: annoy, faiss, Milvus, Elastic, Pinecone

It's like the hello world of current day NLP.

Re:Introducing Notion AI by fzliu on Wednesday November 16, 2022 @12:06PM (#33626549)
Thanks for the shout-out! For folks interested in playing around with vector and/or hybrid search: Milvus is open-source (https://github.com/milvus-io/milvus).
Re:Introducing Notion AI by gk1 on Wednesday November 16, 2022 @12:39PM (#33627133)
This is exactly what Mem does using Pinecone and OpenAI: https://www.pinecone.io/learn/mem-semantic-search/

Almost any self-hosted ANN library will do if you're dealing with <1M vectors, but the indexes at these note-based applications tend to balloon very quickly into the hundreds of millions and billions. That's where rolling your own gets painful and where Pinecone shines.[1]

[1] https://www.pinecone.io - Disclosure: I work there.