Re:Gemini 3 Pro Preview Live in AI Studio
by adastra22 on Tuesday November 18, 2025 @11:57AM
(#45968877)
I maintain a set of prompts and scripts for development using Claude Code. They are still all locked to using Sonnet 4 and Opus 4.1, because Sonnet 4.5 is flaming hot garbage. I’ve stopped trusting the benchmarks for anything.
Re:Gemini 3 Pro Preview Live in AI Studio
by Iulioh on Tuesday November 18, 2025 @11:22AM
(#45968288)
A lot of newer models are geared towards efficency and if you add the fact that more efficent models are trained on the output of less efficent (but more accurate) models....
GPT4/3o might be the best we will ever have
Re:Gemini 3 Pro Preview Live in AI Studio
by Archer6621 on Wednesday November 19, 2025 @02:25AM
(#45976760)
I wonder whether it could be related to some kind of over-fitting, i.e. a prompting style that tends to work better with the older models, but performs worse with the newer ones.
Yeah I have my own set of tests and the results are a bit unsettling in the sense that sometimes older models outperform newer ones. Moreover, they change even if officially the model doesn't change. This is especially true of Gemini 2.5 pro that was performing much better on the same tests several months ago vs. now.