News for hackers. Stuff that matters.

A comment on Show HN: I built a sub-500ms latency voice agent from scratch. Parent comment

Re:Show HN: I built a sub-500ms latency voice agent from scr... by nicktikhonov on Monday March 02, 2026 @07:29PM (#47226266)
100% - I thought about that shortly after writing this up. One way to make this work is to have a tiny, lower latency model generate that first reply out of a set of options, then aggressively cache TTS responses to get the latency super low. Responses like "Hmm, let me think about that..." would be served within milliseconds.
[ Parent | on HN ]
Re:Show HN: I built a sub-500ms latency voice agent from scr... by dotancohen on Monday March 02, 2026 @08:47PM (#47226882)
Years ago I wrote a system that would generate Lucene queries on the fly and return results. The ~250 ms response time was deemed too long, so I added some information about where the response data originated, and started returning "According to..." within 50 ms of the end of user input. So the actual information got to the user after a longer delay, but it felt almost as fast as conversion.
[ Parent | on HN ]
Re:Show HN: I built a sub-500ms latency voice agent from scr... by eru on Tuesday March 03, 2026 @12:02AM (#47228298)
See also any public speaking who starts every answer to a question from the audience (or in a verbal interview) with something like 'that is a good question!' or "thank you for asking me that!"

Same strategy but employed by humans.

[ Parent | on HN ]
Re:Show HN: I built a sub-500ms latency voice agent from scr... by digitallyamar on Tuesday March 03, 2026 @10:56AM (#47234283)
"You are absolutely right!"
[ Parent | on HN ]