News for hackers. Stuff that matters.
Re:Chatbot Arena Leaderboard: Gemini 1.5 Flash, Pro and Adva... by minimaxir on Tuesday May 28, 2024 @03:21PM (#40504487)
Note that the web app output is not necessarily the same as the API output, the latter is which is what LMSys uses.

The web apps tend to have extra security layers.

Re:Chatbot Arena Leaderboard: Gemini 1.5 Flash, Pro and Adva... by jxy on Tuesday May 28, 2024 @03:33PM (#40504656)
Does LMSys even claim to be using the public API? What API endpoint is "Gemini-Advanced-0514"?

Is LMSys "Gemini-1.5-Flash-API-0514" the same as what the public API endpoint "gemini-1.5-flash-001" provides, or "gemini-1.5-flash-preview-0514"? And is LMSys named "Gemini-1.5-Pro-API-0514" the same as "gemini-1.5-pro-preview-0514"?

Re:Chatbot Arena Leaderboard: Gemini 1.5 Flash, Pro and Adva... by theropost on Tuesday May 28, 2024 @03:42PM (#40504761)
Maybe that's a problem for me every time I've tried it completely denies such basic requests, I don't have to worry about how I word things I just want to get my answer based on my inquiry without having to subscribe to a proper way of speaking.