Re:Whisper – open source speech recognition by OpenAI
by fxtentacle on Wednesday September 21, 2022 @05:04PM
(#32931513)
I meant that most research that has been released in papers or code recently uses the same architecture. But all of those research papers use something different than Apple and Google.
As for running the AI 30x, on current hardware that'll make it slower than realtime. Plus all of those 1GB+ models won't fit into a phone anyway.
Re:Whisper – open source speech recognition by OpenAI
by coder543 on Wednesday September 21, 2022 @10:08PM
(#32934066)
> Plus all of those 1GB+ models won't fit into a phone anyway.
I don't think that's a requirement here. I've been playing with Whisper tonight, and even the tiny model drastically outperformed Siri dictation for me in my testing. YMMV, of course.
I doubt people run online transcription for long periods of time on their phone very often, so the battery impact is irrelevant, and the model is ideally running (mostly) on a low power, high performance inference accelerator anyways, which is common to many SoCs these days.