News for hackers. Stuff that matters.
Re:Gemini 1.5 Pro by torginus on Thursday February 15, 2024 @02:27PM (#39387287)
Tbh, I haven't read the paper, but I think it's pretty self-evident that large contexts aren't cheap - the AI has to comb through every word of the context for each successive generated token at least once, so it's going to be at least linear.

There are no comments on this comment yet.