Re:Gemini 3 Flash: frontier intelligence built for speed
by mips_avatar on Wednesday December 17, 2025 @10:33PM
(#46308656)
I'm pretty sure xAI exclusively uses Nvidia H100s for Grok inference but I could be wrong. I agree that I don't see why TPUs would necessarily explain latency.
[ Parent
| on HN ]
Re:Gemini 3 Flash: frontier intelligence built for speed
by danpalmer on Thursday December 18, 2025 @02:04AM
(#46309703)
To be clear I'm only suggesting that hardware is a factor here, it's far from the only reason. The parent commenter corrected their comment that it was actually Groq not Grok that they were thinking of, and I believe they are correct about that as Groq is doing something similar to TPUs to accelerate inference.