News for hackers. Stuff that matters.
Re:Gemini 3 Pro vs. 2.5 Pro in Pokemon Crystal by zurfer on Saturday December 20, 2025 @11:33AM (#46337345)
You're too kind. Even the CEO of Google retweeted how well Gemini 2.5 did on Pokemon. There is a high chance that now it's explicitly part of the training regime. We kind of need a different kind of game to know how well it generalizes.
Re:Gemini 3 Pro vs. 2.5 Pro in Pokemon Crystal by kqr on Saturday December 20, 2025 @01:25PM (#46338306)
I have a draft doing this with text adventures: https://entropicthoughts.com/updated-llm-benchmark