Show HN: BYO AI free notetaking with optional screen reading for OpenClaw/hermes

Re:Show HN: BYO AI free notetaking with optional screen read... by JohnBizBiz on Tuesday July 14, 2026 @10:15AM (#48907260)

Echo cancellation for real-time output is a nasty problem. I hit similar walls with a browser-based take on this (livesuggest.ai) — you get easier distribution but lose a lot of control compared to native. The Founders real-time suggestions piece is what I'd want to try most. What's the end-to-end latency like in practice?

[ Parent | on HN ]

Re:Show HN: BYO AI free notetaking with optional screen read... by piotraleksander on Thursday July 16, 2026 @02:06AM (#48930884)

nice, are you using webrtc aec3 or sth custom?

to your question i did a thorough benchmarking (hence late reply) used 18gb m3 pro macpro

full on-device with gemma 4 e2b is ~1.5s since last utterance. vad silence th is set to 600ms

now, when I connect local hermes agent that uses deepseek v4 flash via their api, latency jumps to 3.5s (this of course includes 600s of silence to even trigger pipeline)

btw, suggestions are throttled to one every 20s by default, it's configurable from the app

afaik cluely is waaaaay over 5s, but it makes sense because their users need lots of ai reasoning to answer interview qs :D different target audience then stagewhisper

[ Parent | on HN ]