News for hackers. Stuff that matters.
Re:Show HN: I built a sub-500ms latency voice agent from scr... by dotancohen on Monday March 02, 2026 @08:47PM (#47226882)
Years ago I wrote a system that would generate Lucene queries on the fly and return results. The ~250 ms response time was deemed too long, so I added some information about where the response data originated, and started returning "According to..." within 50 ms of the end of user input. So the actual information got to the user after a longer delay, but it felt almost as fast as conversion.

There are no comments on this comment yet.