Re:Whisper – open source speech recognition by OpenAI
by lunixbochs on Wednesday September 21, 2022 @07:34PM
(#32933042)
For an offline (non-streaming) model, 1x realtime is actually kind of bad, because you need to wait for the audio to be available before you can start processing it. So if you wait 10 seconds for someone to finish speaking, you won't have the result until 10 seconds after that.
You could use really small chunk sizes and process them in a streaming fashion, but that would impact accuracy, as you're significantly limiting available context.
Edit: According to this comment[0] the base model runs in real time on an M1 CPU. The tiny model apparently decodes an audio file twice as fast. These are promising results.
[0] https://news.ycombinator.com/item?id=32927360#32929739