Re:WhisperSpeech – An open source text-to-speech system buil...
by satvikpendem on Thursday January 18, 2024 @07:30AM
(#39040916)
How much training compute does it require to train from scratch? I'm wondering because I have a lot of audiobooks, they're not necessarily CC licensed though but for my private usage and training I think it'd be fine.
[ Parent
| on HN ]
Re:WhisperSpeech – An open source text-to-speech system buil...
by jpcl on Thursday January 18, 2024 @08:14AM
(#39041264)
Training the T2S model from scratch takes around 8h on 96 A100 GPUs. Training the `tiny` S2A model is around 3x faster (training HQ `small` variant is comparable to T2S).
I think you would get good results with fine-tuning but unfortunately we don't have a user-friendly notebook or script to do that right now. The biggest model is 800MB (FP32) so you won't even need a very big GPU to be able to fine-tune.