Re:Batch Mode in the Gemini API: Process More for Less
by tucnak on Friday July 11, 2025 @05:14AM
(#44529985)
I really hope it means that 2.5 models will be available for batching in Vertex, too. We had spent quite a bit of effort making it work with BigQuery, and it's really cool when it works. There's edge-case, though, where it doesn't work: in case the batch is also referring to cached prompt. We did report this a few months ago.
[ Parent
| on HN ]
There are no comments on this comment yet.