Re:Google Gemini has the worst LLM API
by mgraczyk on Sunday May 11, 2025 @03:17PM
(#43956271)
Thanks, yes makes sense.
BTW, I have noticed that when tested outside GCP, the OpenAI compat endpoint has significantly lower latency for most requests (vs using the genai library). VertexAI is better than both.
BTW, I have noticed that when tested outside GCP, the OpenAI compat endpoint has significantly lower latency for most requests (vs using the genai library). VertexAI is better than both.
Any idea why or if that will change?