Google Gemini has the worst LLM API

Re:Google Gemini has the worst LLM API by logankilpatrick on Sunday May 11, 2025 @03:14PM (#43956241)

We added it to the docs. The downside of the OAI compat endpoint is we have to design the API twice, once for our API, then once through the OAI compat layer which makes it slower sometimes to have certain features, especially if we diverge at all.

[ Parent | on HN ]

Re:Google Gemini has the worst LLM API by mgraczyk on Sunday May 11, 2025 @03:17PM (#43956271)

Thanks, yes makes sense.

BTW, I have noticed that when tested outside GCP, the OpenAI compat endpoint has significantly lower latency for most requests (vs using the genai library). VertexAI is better than both.

Any idea why or if that will change?

[ Parent | on HN ]