OpenAI releases Whisper v3, new generation open source ASR model

Re:OpenAI releases Whisper v3, new generation open source AS... by modeless on Monday November 06, 2023 @02:43PM (#38167811)

I have Whisper working in real time here, with TTS too for a real time voice AI that's much faster than ChatGPT's voice mode: https://www.microsoft.com/store/apps/9NC624PBFGB7

It's inefficient, but even older gaming GPUs are fast enough for real time performance, and accuracy is good. If you were going to train a model from scratch for real time you could do something more efficient, but it works as is.

Edit: I'm not sure what you mean by "you wind up without context for the samples". You can supply context to Whisper.

[ Parent | on HN ]

Re:OpenAI releases Whisper v3, new generation open source AS... by alok-g on Tuesday November 07, 2023 @12:23PM (#38179760)

Nice.

>> Video Memory: 6 GB >> Graphics Processor: Nvidia GPU with 12 GB VRAM or greater

Would it work on an x64 Intel i7 machine with 32 GB RAM and with Nvidia RTX3060 with 6 GB RAM.

[ Parent | on HN ]

Re:OpenAI releases Whisper v3, new generation open source AS... by modeless on Tuesday November 07, 2023 @01:08PM (#38180488)

Unfortunately Microsoft's store doesn't allow requesting more than 6GB of VRAM in a store listing, so that's why it says 6 and 12 in the same listing. The lowest I've tested so far is a 3060 12GB. I wouldn't expect 6GB to work, but if you're willing to give it a try I'd be interested to know what happens.

I'd like to support less VRAM. Maybe a future version will offload some of the processing to the cloud.

[ Parent | on HN ]