I want to believe this, but every time I try Gemini coding assistance within Colab it's utterly dire. Code gen in a cell is OK, but things fall apart when you try to get into a feedback loop. The system prompt/harness fails to inform the agent about what it can and can't do, or does and doesn't have access to. It will confidently tell you it's done a thing, and then you ask, it admits can't actually do that but will happily try and fail again. Very frustrating, because I really like Colab as a platform for little reproducible experiments that may or may not require CUDA.

I suspect Gemini doesn’t focus that much on coding, at least compared to frontier labs. It’s not part of Gemini’s core business case.

Gemini’s integration with maps and search is more important for Google.

That’s a good point, and probably why it’s a multimodal model. I wouldn’t be surprised if it’s over index on code written by Googlers.

My long term base case, too, but they need to install Demis as CEO and I don’t think either side is ready.