News for hackers. Stuff that matters.
Re:Gemini 3 Flash: frontier intelligence built for speed by nl on Thursday December 18, 2025 @12:47AM (#46309285)
Sorry I meant Groq custom hardware, not Grok!

I don't see any latency comparisons in the link

Re:Gemini 3 Flash: frontier intelligence built for speed by danpalmer on Thursday December 18, 2025 @02:03AM (#46309686)
The link is just to the book, the details are scattered throughout. That said the page on GPUs specifically speaks to some of the hardware differences and how TPUs are more efficient for inference, and some of the differences that would lead to lower latency.

https://jax-ml.github.io/scaling-book/gpus/#gpus-vs-tpus-at-...

Re: Groq, that's a good point, I had forgotten about them. You're right they too are doing a TPU-style systolic array processor for lower latency.