Those are just defaults, not the maximum possible context size.
Re:Gemini Ultra Released
by sergiotapia on Thursday February 08, 2024 @12:17PM
(#39304621)
I see where can I read more about their max context size?
Default max (sequence) tokens (stream): 512 Default max (sequence) tokens: 256
https://developers.cloudflare.com/workers-ai/models/text-gen...