News for hackers. Stuff that matters.
Re:Amidst the Noise and Haste, Google Has Successfully Pulle... by mmaunder on Monday January 06, 2025 @07:46PM (#42617936)
Gemini 2 was entirely trained on Trillium, Googles 6th generation TPU. About 100,000 of them. And all inference is run on TPUs.

https://venturebeat.com/ai/google-new-trillium-ai-chip-deliv...

Re:Amidst the Noise and Haste, Google Has Successfully Pulle... by lmm on Monday January 06, 2025 @08:33PM (#42618246)
Right. But are people paying for Gemini? Does all that vertical integration make it cheaper than its competitors? (Which is what works for SpaceX)
Re:Amidst the Noise and Haste, Google Has Successfully Pulle... by nmfisher on Monday January 06, 2025 @09:40PM (#42618578)
Gemini Flash is my go-to for many client projects, so there's at least a few people paying for it. If it fits your use case, it's easily the best value for money, and often makes something commercially viable that wouldn't otherwise be.

Sample size of 1, obviously, so YMMV.

I also pay for Claude Pro for personal coding use, so I'm aware that Flash isn't exactly a drop-in replacement for a more powerful model. From my limited testing, though, Pro 2.0 is almost indistinguishable from 3.5 Sonnet.