Re:Fixing Hallucination with Knowledge Bases
by Xeophon on Thursday May 04, 2023 @08:38PM
(#35823990)
Popular examples are Weaviate and Qdrant
Re:Fixing Hallucination with Knowledge Bases
by colordrops on Thursday May 04, 2023 @08:58PM
(#35824102)
Pgvector for postgres and vector search in Elasticsearch would be two ways to do it without adopting some new untested product.
Re:Fixing Hallucination with Knowledge Bases
by peter_l_downs on Thursday May 04, 2023 @08:58PM
(#35824103)
Potentially Chroma https://www.trychroma.com/ ?
Re:Fixing Hallucination with Knowledge Bases
by jn2clark on Thursday May 04, 2023 @09:15PM
(#35824199)
Not sure which one, but if you are after a vector search engine (not just a database) then I can recommend this https://github.com/marqo-ai/marqo. Includes inference, transformations, schema's, multi-modal search, multi-modal queries, multi-modal representations, text chunking and more.
Re:Fixing Hallucination with Knowledge Bases
by jn2clark on Thursday May 04, 2023 @09:18PM
(#35824216)
This article also has some other methods for hallucination and reference checking by using cross-encoders https://github.com/marqo-ai/marqo/blob/mainline/examples/GPT.... It is not perfect but can be easily modified to make it more robust.
Milvus (https://milvus.io) and Vespa (https://vespa.ai) are great choices if you're looking for hardened, scalable, and production-ready vector databases.
We (Milvus) also have `milvus-lite` if you'd like something pip installable: python3 -m pip install milvus
Re:Fixing Hallucination with Knowledge Bases
by crazyedgar on Thursday May 04, 2023 @11:36PM
(#35824935)
I can’t seem to find it. Does anyone recall the name?