Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5
by a_wild_dandan on Thursday November 16, 2023 @03:08PM
(#38294759)
I’m also interested in peoples’ experience. I’d expect decent performance: Whisper 3 has many model sizes, down to 35Mb, iirc. Training, and especially inference, should be doable on a Pi5.
[ Parent
| on HN ]
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5
by jafermarq on Thursday November 16, 2023 @03:35PM
(#38295072)
Yes. The example uses Whisper-tiny which is 39M, a perfect match for the downstream task of keyword spotting. Just one line needs to be changed in the code to run a larger Whisper model :)
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5
by kkielhofner on Thursday November 16, 2023 @03:46PM
(#38295225)
> Whisper 3 has many model sizes
Nitpick but important - Whisper v2 and v3 are large only. It's actually the same Whisper but the version of the model (large-v2, large-v3) has been updated.
All of the other model sizes are the original release.
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5
by a_wild_dandan on Thursday November 16, 2023 @06:34PM
(#38297193)
I reread your comment multiple times and still don’t understand the important nitpick. Are you saying that the smaller models haven’t been updated alongside the Whisper 3 release? That makes the most sense to me, but I don’t want to misinterpret what you mean!