News for hackers. Stuff that matters.
Re:From where I left by some1else on Tuesday December 10, 2024 @01:30PM (#42379710)
Where would a Redis vector store play a part though? Maybe you'd load up relevant embeddings for a particular user while they're interacting with their dataset, to make their responses quicker? You've already spent the effort on hydrating their data out of persistence though. I guess step one is likely being a more trusted alternative to the in-memory vector solutions like HNSW, Faiss, and a potentially faster engine than pg_vector. I've always seen Redis as an augmentation, but maybe in this role it can take the helm?
Re:From where I left by simonw on Tuesday December 10, 2024 @01:34PM (#42379775)
It's exactly that. Redis is an in-memory data structure server that you can outsource index-style operations to. Vector similarity is a type of index search. I think it's an exact fit for Redis.
Re:From where I left by some1else on Tuesday December 10, 2024 @01:53PM (#42380053)
Cool. Redis in front of Postgres always brought peace-of-mind that will likely be welcome for the vector data use-case.

P.s.: Appreciate the llm command line tool.