News for hackers. Stuff that matters.

A comment on I'm writing a new vector search SQLite Extension. Parent comment

Re:I'm writing a new vector search SQLite Extension by alexgarcia-xyz on Friday May 03, 2024 @01:13AM (#40244292)
That's great to hear, thanks for sharing! Will definitely have benchmarks to share later

Would love to hear about the scale of the vector data you're working with in your local app. Do you actually find yourself with > 1 million vectors? Do you get away with just storing it all in-memory?

[ Parent | on HN ]
Re:I'm writing a new vector search SQLite Extension by xyc on Friday May 03, 2024 @01:32AM (#40244399)
I don't think we need > 1 million vector yet. But we plan to target folder of local document such as obsidian vault or store web search results which could rack up a large number of vectors. Persistence on disk is also a desired feature when looking at the choices because we don't want to reindex existing files.

Benchmark is also not everything, easiness to embed and integrate with existing sqlite apps could make sqlite-vec stand out and help with adoption.

[ Parent | on HN ]