The LLM RAG Obituary: Killed by Agents, Buried by Context Windows

Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by nbstme on Wednesday October 01, 2025 @09:06PM (#45445399)

But don’t you think LLM pricing is heading toward zero? It seems to halve every six months. And on privacy, you can hope model providers won’t train on your data, (but there’s no guarantee)

[ Parent | on HN ]

Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by queenkjuul on Wednesday October 01, 2025 @10:56PM (#45445938)

I don't see how it can trend to zero when none of the vendors are profitable. Uber and doordash et. al. increased in price over time. The era of "free" LLM usage can't be permanent

[ Parent | on HN ]

Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by dangoodmanUT on Thursday October 02, 2025 @12:46AM (#45446393)

Google’s inference is profitable

[ Parent | on HN ]

Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by jgalt212 on Thursday October 02, 2025 @08:28AM (#45448774)

Not on the SERP page. The zero click Internet is bad for content producers and for those who sell ads (Google).

[ Parent | on HN ]

Re:The LLM RAG Obituary: Killed by Agents, Buried by Context... by imiric on Thursday October 02, 2025 @01:26AM (#45446568)

Oh, it's going to be "free" alright, in the same way that most web services are today. I.e., you will pay for it with your data and attention.

The only difference is that the advertising will be much more insidious and manipulative, the data collection far easier since people are already willingly giving it up, and the business much more profitable.

I can hardly wait.

[ Parent | on HN ]