News for hackers. Stuff that matters.

crazy_marksman

Show HN: A pgvector fork with the performance of Pinecone

https://medium.com/@sweta.vooda/pgvector-remote-a-pgvector-fork-with-the-performance-of-pinecone-5d8a7f6a50bd

Hi friends,Excited to share our latest project, pgvector-remote, with you all!pgvector-remote is an extension designed to effortlessly incorporate remote vector stores, like Pinecone, into pgvector. With pgvector-remote, harnessing the power of a remote (Pinecone) index becomes as easy as utilizing ivfflat or hnsw.Why pgvector-remote?1. Simplifies integration of memory-intensive vector indexes...

( Read More... | no comments | 3 points | on HN )
Re:Vector database is not a separate database category on Tuesday October 03, 2023 @04:12AM (#37749183)
How do you deal with security and access control across postgres and pinecone?
Another option is to cold email investors in case you are open to working at a start up.
Re:Beautiful LaTeX Book with Examples on Saturday September 30, 2023 @08:28PM (#37721326)
So much hate :( I agree the repo needs some clean up to be useful. Nevertheless, good collection!
Re:How to Pick a Vector Database – Quantitative Analysis on Thursday September 28, 2023 @03:59PM (#37694971)
Key Insights:

1. Many database back up their data in a sqlite database. Some even push vectors into sqlite, but others store vectors in their own format.

2. Qdrant has higher client connection and index initialization time that can shadow its benefit on fast and accurate vector search.

Are you using RAG to synthesize responses?
Re:Ask HN: How did LLMs change your products? on Monday September 18, 2023 @12:49PM (#37558636)
Made it easier to document code. You can send the function as context, and it will generate a well-formatted docstring that accomplishes 90% of the task!
I don't believe there is a solution otherwise. All you can do is cross join.
I appreciate your view on using LLMs in production. However, I think the ability to use ML/AI directly within databases is a significant step forward. Most production systems already rely on predictions, so the idea of using them without leaving the database is both interesting and valuable.
Re:SQLite-Vss: A SQLite Extension for Vector Search on Monday September 18, 2023 @06:45AM (#37554496)
Awesome work! What is the preferred way of adding embeddings in sqlite table?
Re:Show HN: Vanna AI – Open-Sourced Text-to-SQL in Python on Sunday September 10, 2023 @12:22PM (#37457342)
Is there a token limit for the train step? Like length of documentation, number of example SQL queries?
Re:Show HN: Vanna AI – Open-Sourced Text-to-SQL in Python on Friday September 08, 2023 @08:47PM (#37441091)
Impressive! Quick question - is it possible to generate sql for a slight variant of sql? My project augments standard sql with a few new constructs.
Re:Ask HN: Why are most US startups not solving novel problems? on Friday September 08, 2023 @12:56PM (#37436170)
Some academic startups do come up with novel ideas, but the novelty typically lies in the technology rather than the marketing standpoint. For example, Anyscale offers a novel technology, but from a business perspective, it is a generic scalable training framework.