News for hackers. Stuff that matters.
Re:Batch Mode in the Gemini API: Process More for Less by laborcontract on Friday July 11, 2025 @10:08AM (#44532342)
One open secret is that batch mode generations often take much less than 24 hours. I've done a lot of generations where I get my results within 5ish minutes.
Re:Batch Mode in the Gemini API: Process More for Less by ridgewell on Friday July 11, 2025 @06:28PM (#44537409)
It can depend a lot on the shape of your batch to my understanding. A small batch job can be tasked out a lot quicker than a large batch job waiting for just the right moment where capacity fits.