News for hackers. Stuff that matters.

A comment on Gemini Flash. Parent comment

Re:Gemini Flash by cathalc on Wednesday May 15, 2024 @10:07AM (#40367155)
Absolutely. Gemini results tend to drop off after 128k tokens according to RULER: https://github.com/hsiehjackson/RULER
[ Parent | on HN ]
Re:Gemini Flash by ayyndrew on Thursday May 16, 2024 @04:32AM (#40376295)
If I'm reading the paper right, it says Gemini 1.5 is good up to 128k, and RULER doesn't test beyond 128k
[ Parent | on HN ]
Re:Gemini Flash by cathalc on Thursday May 16, 2024 @10:13AM (#40378739)
Hmm perhaps you are right.. There's no context on the page about what ">128k" means so possibly a bad assumption on my part!
[ Parent | on HN ]