Re:Vespa.ai is spinning out of Yahoo as a separate company
by swyx on Wednesday October 04, 2023 @08:41PM
(#37773589)
> I've been meaning to dive into SCaNN and DiskANN as well, but haven't gotten around to it yet.
quick TLDR on both vs HNSW?
Re:Vespa.ai is spinning out of Yahoo as a separate company
by aiunboxed on Wednesday October 04, 2023 @09:37PM
(#37773965)
any ideas what do cloud providers like pinecone user underneath ?
Re:Vespa.ai is spinning out of Yahoo as a separate company
by gk1 on Wednesday October 04, 2023 @11:05PM
(#37774499)
I'm from Pinecone. We use proprietary indexes. We could've used HNSW but decided the high memory consumption (ie, costly at scale) and slow index updates (ie, data gets stale) won't cut it for production use cases.
Re:Vespa.ai is spinning out of Yahoo as a separate company
by eskimo87 on Thursday October 05, 2023 @01:55PM
(#37781745)
Oh I read a lot of HNSW stuff on your/Pinecone blog series. (Great learning resource btw, well done!) So I assumed you were using HNSW already. It's a news to me that you don't use it.
I've been meaning to dive into SCaNN and DiskANN as well, but haven't gotten around to it yet.