News for hackers. Stuff that matters.
Re:Gemini 3 Flash: frontier intelligence built for speed by mips_avatar on Wednesday December 17, 2025 @10:27PM (#46308614)
I don't think the models are doing this, time to first token is more of a hardware thing. But people writing agents are definitely doing this, particularly in voice it's worth it to use a smaller local llm to handle the acknowledgment before handing it off.

There are no comments on this comment yet.