News for hackers. Stuff that matters.
Re:Fixing Hallucination with Knowledge Bases by tmaly on Thursday May 04, 2023 @08:35PM (#35823971)
There was an open source vector database that was suppose to be an alternative to pinecone that was mentioned a few weeks back.

I can’t seem to find it. Does anyone recall the name?

Re:Fixing Hallucination with Knowledge Bases by Xeophon on Thursday May 04, 2023 @08:38PM (#35823990)
Popular examples are Weaviate and Qdrant
Re:Fixing Hallucination with Knowledge Bases by colordrops on Thursday May 04, 2023 @08:58PM (#35824102)
Pgvector for postgres and vector search in Elasticsearch would be two ways to do it without adopting some new untested product.
Re:Fixing Hallucination with Knowledge Bases by peter_l_downs on Thursday May 04, 2023 @08:58PM (#35824103)
Potentially Chroma https://www.trychroma.com/ ?
Re:Fixing Hallucination with Knowledge Bases by jn2clark on Thursday May 04, 2023 @09:15PM (#35824199)
Not sure which one, but if you are after a vector search engine (not just a database) then I can recommend this https://github.com/marqo-ai/marqo. Includes inference, transformations, schema's, multi-modal search, multi-modal queries, multi-modal representations, text chunking and more.
Re:Fixing Hallucination with Knowledge Bases by jn2clark on Thursday May 04, 2023 @09:18PM (#35824216)
This article also has some other methods for hallucination and reference checking by using cross-encoders https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT.... It is not perfect but can be easily modified to make it more robust.
Re:Fixing Hallucination with Knowledge Bases by fzliu on Thursday May 04, 2023 @10:08PM (#35824504)
Milvus (https://milvus.io) and Vespa (https://vespa.ai) are great choices if you're looking for hardened, scalable, and production-ready vector databases.

We (Milvus) also have `milvus-lite` if you'd like something pip installable: python3 -m pip install milvus

Re:Fixing Hallucination with Knowledge Bases by crazyedgar on Thursday May 04, 2023 @11:36PM (#35824935)