News for hackers. Stuff that matters.
Re:Batch Mode in the Gemini API: Process More for Less by Deathmax on Friday July 11, 2025 @10:39AM (#44532647)
Vertex's offering of Gemini very much does implicit caching, and has always been the case [1]. The recent addition of applying implicit cache hit discounts also works on Vertex, as long as you don't use the `global` endpoint and hit one of the regional endpoints.

[1]: http://web.archive.org/web/20240517173258/https://cloud.goog..., "By default Google caches a customer's inputs and outputs for Gemini models to accelerate responses to subsequent prompts from the customer. Cached contents are stored for up to 24 hours."

There are no comments on this comment yet.