News for hackers. Stuff that matters.
Re:Introduction to Vector Similarity Search by jeffchuber on Wednesday July 12, 2023 @12:49AM (#36690575)
Really just chroma + openai is all you need. Chroma makes this easy https://docs.trychroma.com/embeddings.

All you have to do is chunk... I'd start at a paragraph and experiment.

Re:Introduction to Vector Similarity Search by chaxor on Wednesday July 12, 2023 @01:03AM (#36690644)
This is not always good advice. Many people require to not use off premise models, due to data ownership issues.

I would therefore suggest a better default for this, such as BERT+Qdrant.

It would be wonderful if there were a simpler (single file, SQLite or DuckDB like) database for vectors than the complex (and in some cases, unfortunately cloud-based) ones available now.

Re:Introduction to Vector Similarity Search by jeffchuber on Wednesday July 12, 2023 @01:23AM (#36690744)
ah sorry, i should read OP better - chroma's default embedding model is sentence transformers - and we have many other integrated - https://github.com/chroma-core/chroma/blob/main/chromadb/uti...

> It would be wonderful if there were a simpler (single file, SQLite or DuckDB like) database for vectors than the complex (and in some cases, unfortunately cloud-based) ones available now.

This is literally chroma!

Re:Introduction to Vector Similarity Search by chaxor on Wednesday July 12, 2023 @10:51AM (#36695420)
Admittedly, I don't know much about chroma, but it seems similar to Qdrant to me. Perhaps I'm missing something. It doesn't appear that it stores everything in 1 singledb file, but rather a plethora of files in some directory. Although it does appear that it runs local, which is a huge plus.
Re:Introduction to Vector Similarity Search by fzliu on Wednesday July 12, 2023 @01:51AM (#36690884)
You might enjoy milvus-lite: https://zilliz.com/blog/exploring-magic-vector-databases-jup...

   pip install milvus
Re:Introduction to Vector Similarity Search by drewcperkins on Wednesday July 12, 2023 @03:02AM (#36691270)
Chroma is just a wrapper for Clickhouse. I’d go with something like Weaviate or Qdrant that is a lot more mature as far as vector databases.
Re:Introduction to Vector Similarity Search by redskyluan on Wednesday July 12, 2023 @08:25AM (#36693528)
how do you define chroma as a vector db? a wrapper on top of other databases and hnsw? What about a billion vectors in house~ is chroma all we need?