News for hackers. Stuff that matters.
Re:Our next-generation model: Gemini 1.5 by chasd00 on Thursday February 15, 2024 @04:22PM (#39389091)
are you going to upload 10M tokens to Gemini on every request? That's a lot of data moving around when the user is expecting a near realtime response. Seems like it would still be better to only set the context with information relevant to the user's prompt which is what plain rag does.

There are no comments on this comment yet.