Re:Vector Databases: A Technical Primer [pdf]
by dimatura on Friday January 12, 2024 @03:15PM
(#38973364)
Any recommendations for an embedded embedding database (heh)? Embedded, as in sqlite. For smaller-scale problems, but hopefully more convenient than say, LMDB + FAISS.
[ Parent
| on HN ]
Re:Vector Databases: A Technical Primer [pdf]
by PhilippGille on Friday January 12, 2024 @04:27PM
(#38974340)
For Python I believe Chroma [1] can be used embedded.
For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go
It's neither advanced nor for scale yet, but the RAG demo works.
Re:Vector Databases: A Technical Primer [pdf]
by dimatura on Friday January 12, 2024 @05:00PM
(#38974710)
awesome, how did I not find this :D
Re:Vector Databases: A Technical Primer [pdf]
by ripley12 on Friday January 12, 2024 @03:28PM
(#38973539)
FWIW, Simon Willison's `llm` tool just uses SQLite plus a few UDFs. The simplicity of that approach is appealing to me but I don't have a good sense of when+why it becomes insufficient.
Re:Vector Databases: A Technical Primer [pdf]
by dimatura on Friday January 12, 2024 @03:36PM
(#38973664)
Thanks, I'll check it out.
Re:Vector Databases: A Technical Primer [pdf]
by pjot on Friday January 12, 2024 @03:51PM
(#38973849)
I actually just finished a POC using DuckDB that does similarity search for HN comments.
Re:Vector Databases: A Technical Primer [pdf]
by dmezzetti on Friday January 12, 2024 @06:24PM
(#38975558)
You can take a look at txtai (https://github.com/neuml/txtai). It can run in a Python process. It has support for storing content in SQLite and embeddings vectors in local vector index formats (Faiss, HNSW, Annoy).
Disclaimer: I'm the primary author of txtai.
Re:Vector Databases: A Technical Primer [pdf]
by ehsanu1 on Friday January 12, 2024 @07:06PM
(#38975887)
I've used usearch successfully for a small project: https://github.com/unum-cloud/usearch/
Re:Vector Databases: A Technical Primer [pdf]
by wdroz on Saturday January 13, 2024 @02:50AM
(#38978069)
The qdrant clients support a local mode where you point to a file[0].
Re:Vector Databases: A Technical Primer [pdf]
by andre-z on Saturday January 13, 2024 @03:19AM
(#38978157)
Qdrant as a library project
https://github.com/tyrchen/qdrant-lib