News for hackers. Stuff that matters.

A comment on Pg_vectorize: The simplest way to do vector search and RAG on Postgres. Parent comment

Re:Pg_vectorize: The simplest way to do vector search and RA... by politelemon on Wednesday March 06, 2024 @04:05PM (#39621440)
This just isn't working for me, phi-2 starts summarizing the document I'm giving it. I tried a few news articles and blog posts. Does using a GGUF version make a difference?
[ Parent | on HN ]
Re:Pg_vectorize: The simplest way to do vector search and RA... by CuriouslyC on Wednesday March 06, 2024 @08:55PM (#39624233)
Depending on the number of bits in the quantization, for sure. The most common failure mode should be minor restatements which you can choose to ignore or not.
[ Parent | on HN ]