I do wonder how low latency can feasibly get. I think there's an interesting barrier to cross with letting speach-to-text correct previously emitted tokens when later context reveals "mishearings" that would help. I know I've seen some systems do that so it's definitely possible, just not something that's readily supported by Whisper as it stands.