Re:Google Gemini has the worst LLM API
by candiddevmike on Saturday May 03, 2025 @09:59PM
(#43883881)
The models are great but the quotas are a real pain in the ass. You will be fighting other customers for capacity if you end up needing to scale. If you have serious Gemini usage in mind, you almost have to have a Google Cloud TAM to advocate for your usage and quotas.
[ Parent
| on HN ]
Re:Google Gemini has the worst LLM API
by chrisheecho on Sunday May 04, 2025 @02:48AM
(#43885003)
We have moved our quota system to Dynamic Shared Quota (https://cloud.google.com/vertex-ai/generative-ai/docs/quotas) for 2.0+ models. There are no quotas in DSQ. If you need a guaranteed throughput there is an option to purchase Provisioned Throughput (https://cloud.google.com/vertex-ai/generative-ai/docs/provis...).
Re:Google Gemini has the worst LLM API
by egamirorrim on Sunday May 04, 2025 @03:15AM
(#43885112)
The thing is that the entry level of provisioned throughput is so high! I just want a reliable model experience for my small Dev team using models through Vertex but I don't think there's anything I can buy there to ensure it.
Re:Google Gemini has the worst LLM API
by dist-epoch on Sunday May 04, 2025 @08:18AM
(#43886299)
While we are talking about quotas, can you maybe add an easy way of checking how much you've used/got left?
Apparently now you need to use google-cloud-quotas to get the limit and google-cloud-monitoring to get the usage.
VS Code copilot managed to implement the first part, getting the limit using gemini-2.5-pro, but when I asked gemini to implement the second part it said that integrating cloud-monitoring is too complex and it can't do it !!!!