News for hackers. Stuff that matters.
Re:Anthropic – Introducing Contextual Retrieval by davedx on Friday September 20, 2024 @11:34AM (#41602993)
Cost is one aspect, but what about ingest time? You’re adding significant processing time to your pipeline with this method right?
Re:Anthropic – Introducing Contextual Retrieval by simonw on Friday September 20, 2024 @01:27PM (#41604002)
I expect most implementations of RAG don't mind this too much - if you're dealing with only a few hundred more pages of documents a day the ingestion time from using fancy tricks like this is going to be measured in minutes.