News for hackers. Stuff that matters.

A comment on WhisperSpeech – An open source text-to-speech system built by inverting Whisper. Parent comment

Re:WhisperSpeech – An open source text-to-speech system buil... by jpcl on Thursday January 18, 2024 @06:23AM (#39040490)
Yeah, the Mimic is a lot less resource intensive. We are working to improve WhisperSpeech in this regard but it's probably always going to require more compute (but in return you'll get higher quality).

That said if you have a modern NVidia GPU you should be able to run a voice-bot in real-time with WhisperSpeech.

[ Parent | on HN ]
Re:WhisperSpeech – An open source text-to-speech system buil... by freedomben on Thursday January 18, 2024 @10:59AM (#39043354)
Will something like whisper.cpp be possible for whisper speech?
[ Parent | on HN ]
Re:WhisperSpeech – An open source text-to-speech system buil... by jpcl on Thursday January 18, 2024 @12:39PM (#39044790)
We looked at this at one point and it seems whisper.cpp/llama.cpp have all the bits needed to make it work. I'd love to help if someone wanted to give it a shot.
[ Parent | on HN ]