News for hackers. Stuff that matters.
Re:RAG at scale: Synchronizing and ingesting billions of tex... by vimota on Tuesday October 10, 2023 @09:26PM (#37839913)
Similar to you, for polling you only see new data not the deletion events so I can't delete embeddings unless I keep track of state and do a diff. To properly support that you/I would need effectively CDC, which gets more complex for arbitrary / self-serve databases.

There are no comments on this comment yet.