Re:Anthropic – Introducing Contextual Retrieval
by davedx on Friday September 20, 2024 @11:34AM
(#41602993)
Cost is one aspect, but what about ingest time? You’re adding significant processing time to your pipeline with this method right?
[ Parent
| on HN ]
Re:Anthropic – Introducing Contextual Retrieval
by simonw on Friday September 20, 2024 @01:27PM
(#41604002)
I expect most implementations of RAG don't mind this too much - if you're dealing with only a few hundred more pages of documents a day the ingestion time from using fancy tricks like this is going to be measured in minutes.