News for hackers. Stuff that matters.
Re:Vespa.ai is spinning out of Yahoo as a separate company by fzliu on Wednesday October 04, 2023 @07:24PM (#37773068)
We have a "Vector Database 101" series that covers vector search and vector indexes as well: https://zilliz.com/learn/what-is-vector-database

I've been meaning to dive into SCaNN and DiskANN as well, but haven't gotten around to it yet.

Re:Vespa.ai is spinning out of Yahoo as a separate company by swyx on Wednesday October 04, 2023 @08:41PM (#37773589)
> I've been meaning to dive into SCaNN and DiskANN as well, but haven't gotten around to it yet.

quick TLDR on both vs HNSW?

Re:Vespa.ai is spinning out of Yahoo as a separate company by aiunboxed on Wednesday October 04, 2023 @09:37PM (#37773965)
any ideas what do cloud providers like pinecone user underneath ?
Re:Vespa.ai is spinning out of Yahoo as a separate company by gk1 on Wednesday October 04, 2023 @11:05PM (#37774499)
I'm from Pinecone. We use proprietary indexes. We could've used HNSW but decided the high memory consumption (ie, costly at scale) and slow index updates (ie, data gets stale) won't cut it for production use cases.
Re:Vespa.ai is spinning out of Yahoo as a separate company by eskimo87 on Thursday October 05, 2023 @01:55PM (#37781745)
Oh I read a lot of HNSW stuff on your/Pinecone blog series. (Great learning resource btw, well done!) So I assumed you were using HNSW already. It's a news to me that you don't use it.