News for hackers. Stuff that matters.
Re:An LLM does not need to understand MCP by pillefitz on Thursday August 07, 2025 @11:53AM (#44826127)
The problem of overflowing context is solved by RAGs, though.
Re:An LLM does not need to understand MCP by lelanthran on Thursday August 07, 2025 @12:25PM (#44826571)
> The problem of overflowing context is solved by RAGs, though.

No, it isn't.

It's mitigated with RAGs, but RAGs add to the context, and what they add might be irrelevant is all the retriever module is doing is plain text search.

If the retriever module is performing an embeddings/vector search on a properly prepared dataset you may have more luck, but it's still a piss-poor experience compared to simply putting all the tools into the context.

Of course, I'm not an expert, so I welcome corrections.

Re:An LLM does not need to understand MCP by dragonwriter on Thursday August 07, 2025 @05:39PM (#44830704)
RAG mitigates somewhat the problem of insufficient context, it does not solve it.