News for hackers. Stuff that matters.
Re:Gemini 3 Flash: frontier intelligence built for speed by mips_avatar on Wednesday December 17, 2025 @10:33PM (#46308656)
I'm pretty sure xAI exclusively uses Nvidia H100s for Grok inference but I could be wrong. I agree that I don't see why TPUs would necessarily explain latency.
Re:Gemini 3 Flash: frontier intelligence built for speed by danpalmer on Thursday December 18, 2025 @02:04AM (#46309703)
To be clear I'm only suggesting that hardware is a factor here, it's far from the only reason. The parent commenter corrected their comment that it was actually Groq not Grok that they were thinking of, and I believe they are correct about that as Groq is doing something similar to TPUs to accelerate inference.