News for hackers. Stuff that matters.
Re:Batch Mode in the Gemini API: Process More for Less by diggan on Friday July 11, 2025 @08:16AM (#44531272)
> Now you can process 10,000 prompts like “Summarize each customer review in one line” for half the cost, provided you’re willing to wait until tomorrow for the results.

Sounds like a great option to have available? Not every task I use LLMs for need immediate responses, and if I wasn't using local models for those things, getting a 50% discount and having to wait a day sounds like a fine tradeoff.

There are no comments on this comment yet.