Re:Introduction to Vector Similarity Search
by chaxor on Wednesday July 12, 2023 @01:03AM
(#36690644)
This is not always good advice. Many people require to not use off premise models, due to data ownership issues.
I would therefore suggest a better default for this, such as BERT+Qdrant.
It would be wonderful if there were a simpler (single file, SQLite or DuckDB like) database for vectors than the complex (and in some cases, unfortunately cloud-based) ones available now.
Re:Introduction to Vector Similarity Search
by jeffchuber on Wednesday July 12, 2023 @01:23AM
(#36690744)
ah sorry, i should read OP better - chroma's default embedding model is sentence transformers - and we have many other integrated - https://github.com/chroma-core/chroma/blob/main/chromadb/uti...
> It would be wonderful if there were a simpler (single file, SQLite or DuckDB like) database for vectors than the complex (and in some cases, unfortunately cloud-based) ones available now.
This is literally chroma!
Re:Introduction to Vector Similarity Search
by chaxor on Wednesday July 12, 2023 @10:51AM
(#36695420)
Admittedly, I don't know much about chroma, but it seems similar to Qdrant to me. Perhaps I'm missing something.
It doesn't appear that it stores everything in 1 singledb file, but rather a plethora of files in some directory. Although it does appear that it runs local, which is a huge plus.
Re:Introduction to Vector Similarity Search
by fzliu on Wednesday July 12, 2023 @01:51AM
(#36690884)
You might enjoy milvus-lite: https://zilliz.com/blog/exploring-magic-vector-databases-jup...
pip install milvus
Re:Introduction to Vector Similarity Search
by drewcperkins on Wednesday July 12, 2023 @03:02AM
(#36691270)
Chroma is just a wrapper for Clickhouse. I’d go with something like Weaviate or Qdrant that is a lot more mature as far as vector databases.
Re:Introduction to Vector Similarity Search
by redskyluan on Wednesday July 12, 2023 @08:25AM
(#36693528)
how do you define chroma as a vector db?
a wrapper on top of other databases and hnsw?
What about a billion vectors in house~ is chroma all we need?
All you have to do is chunk... I'd start at a paragraph and experiment.