News for hackers. Stuff that matters.
Re:Pg_vectorize: The simplest way to do vector search and RA... by pid-1 on Wednesday March 06, 2024 @04:52AM (#39614177)
I had similar experiences. Can't understand all the hype around RAG when the results are so bad.
Re:Pg_vectorize: The simplest way to do vector search and RA... by c_ehlen on Wednesday March 06, 2024 @05:18AM (#39614347)
I‘m using it in for an internal application and the results so far are amazing. Considering it was hacked together in a few hours.

It helps a lot with discovery. We have some large PDFs and also a large amount of smaller PDFs. Simply asking a question, getting an answer with the exact location in the pdf is really helpful.

Re:Pg_vectorize: The simplest way to do vector search and RA... by qrios on Wednesday March 06, 2024 @07:44AM (#39615322)
From our experience simple RAG is often not that helpful as the questions itself are not represented in the vector space (except you use an FAQ dataset as input). Either a preprocessing by an LLM or specific context handling needs to be done.