News for hackers. Stuff that matters.

A comment on How OpenAI delivers low-latency voice AI at scale. Parent comment

Re:How OpenAI delivers low-latency voice AI at scale by zarldev on Monday May 04, 2026 @05:54PM (#48015514)
Yeah Gemma4 was and is great fun to do this with - I too am building pretty much the same as yourself in Go.

https://github.com/zarldev/zarl & https://www.zarl.dev/posts/hal-by-any-other-name

[ Parent | on HN ]
Re:How OpenAI delivers low-latency voice AI at scale by jaggederest on Monday May 04, 2026 @07:06PM (#48016130)
Looks like everyone is building one of these, I have my own little version that's using streaming STT, it can actually be too fast in some cases, and I have a little ring buffer grabbing audio from before the wake word detection fires (so it can hear "Hey Jarvis, turn on the lights" without deliberate pause) https://github.com/jaggederest/pronghorn/
[ Parent | on HN ]