News for hackers. Stuff that matters.
Re:Vector Databases: A Technical Primer [pdf] by dimatura on Friday January 12, 2024 @03:15PM (#38973364)
Any recommendations for an embedded embedding database (heh)? Embedded, as in sqlite. For smaller-scale problems, but hopefully more convenient than say, LMDB + FAISS.
Re:Vector Databases: A Technical Primer [pdf] by PhilippGille on Friday January 12, 2024 @04:27PM (#38974340)
For Python I believe Chroma [1] can be used embedded.

For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go

It's neither advanced nor for scale yet, but the RAG demo works.

[1] https://github.com/chroma-core/chroma

Re:Vector Databases: A Technical Primer [pdf] by catketch on Friday January 12, 2024 @04:29PM (#38974365)
Re:Vector Databases: A Technical Primer [pdf] by dimatura on Friday January 12, 2024 @05:00PM (#38974710)
awesome, how did I not find this :D
Re:Vector Databases: A Technical Primer [pdf] by ripley12 on Friday January 12, 2024 @03:28PM (#38973539)
FWIW, Simon Willison's `llm` tool just uses SQLite plus a few UDFs. The simplicity of that approach is appealing to me but I don't have a good sense of when+why it becomes insufficient.
Re:Vector Databases: A Technical Primer [pdf] by dimatura on Friday January 12, 2024 @03:36PM (#38973664)
Thanks, I'll check it out.
Re:Vector Databases: A Technical Primer [pdf] by pjot on Friday January 12, 2024 @03:51PM (#38973849)
I actually just finished a POC using DuckDB that does similarity search for HN comments.

https://github.com/patricktrainer/hackernews-comment-search

Re:Vector Databases: A Technical Primer [pdf] by dmezzetti on Friday January 12, 2024 @06:24PM (#38975558)
You can take a look at txtai (https://github.com/neuml/txtai). It can run in a Python process. It has support for storing content in SQLite and embeddings vectors in local vector index formats (Faiss, HNSW, Annoy).

Disclaimer: I'm the primary author of txtai.

Re:Vector Databases: A Technical Primer [pdf] by ehsanu1 on Friday January 12, 2024 @07:06PM (#38975887)
I've used usearch successfully for a small project: https://github.com/unum-cloud/usearch/
Re:Vector Databases: A Technical Primer [pdf] by wdroz on Saturday January 13, 2024 @02:50AM (#38978069)
The qdrant clients support a local mode where you point to a file[0].

[0] -- https://github.com/qdrant/qdrant-client#local-mode

Re:Vector Databases: A Technical Primer [pdf] by andre-z on Saturday January 13, 2024 @03:19AM (#38978157)
Qdrant as a library project https://github.com/tyrchen/qdrant-lib