News for hackers. Stuff that matters.
Re:Gemini: Google's most capable AI model yet by caesil on Wednesday December 06, 2023 @11:45AM (#38546259)
If you think eval numbers mean a model is close to 4, then you clearly haven't been scarred by the legions of open source models which claim 4-level evals but clearly struggle to actually perform challenging work as soon as you start testing

Perhaps Gemini is different and Google has tapped into their own OpenAI-like secret sauce, but I'm not holding my breath

There are no comments on this comment yet.