News for hackers. Stuff that matters.

A comment on The LLM RAG Obituary: Killed by Agents, Buried by Context Windows.

Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by djoldman on Wednesday October 01, 2025 @08:00PM (#45445051)
... for this specific use case (financial documents).

These corpora have a high degree of semantic ambiguity among other tricky and difficult to alleviate issues.

Other types of text are far more amenable to RAG and some are large enough that RAG will probably be the best approach for a good while.

For example: maintenance manuals and regulation compendiums.

[ Parent | on HN ]
Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by nbstme on Wednesday October 01, 2025 @08:36PM (#45445248)
Why? What if LLMs could parallelize much of their reading and then summarize the findings into a markdown file, eliminating the need for complicated search?
[ Parent | on HN ]