News for hackers. Stuff that matters.
Re:Our next-generation model: Gemini 1.5 by CuriouslyC on Thursday February 15, 2024 @11:02AM (#39384322)
A perfect RAG system would probably outperform everything in a larger context due to prompt dilution, but in the real world putting everything in context will win a lot of the time. The large context system will also almost certainly be more usable due to elimination of retrieval latency. The large context system might lose on price/performance though.

There are no comments on this comment yet.