News for hackers. Stuff that matters.
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5 by a_wild_dandan on Thursday November 16, 2023 @03:08PM (#38294759)
I’m also interested in peoples’ experience. I’d expect decent performance: Whisper 3 has many model sizes, down to 35Mb, iirc. Training, and especially inference, should be doable on a Pi5.
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5 by jafermarq on Thursday November 16, 2023 @03:35PM (#38295072)
Yes. The example uses Whisper-tiny which is 39M, a perfect match for the downstream task of keyword spotting. Just one line needs to be changed in the code to run a larger Whisper model :)
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5 by kkielhofner on Thursday November 16, 2023 @03:46PM (#38295225)
> Whisper 3 has many model sizes

Nitpick but important - Whisper v2 and v3 are large only. It's actually the same Whisper but the version of the model (large-v2, large-v3) has been updated.

All of the other model sizes are the original release.

Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5 by a_wild_dandan on Thursday November 16, 2023 @06:34PM (#38297193)
I reread your comment multiple times and still don’t understand the important nitpick. Are you saying that the smaller models haven’t been updated alongside the Whisper 3 release? That makes the most sense to me, but I don’t want to misinterpret what you mean!
Re:Federated Finetuning of OpenAI's Whisper on Raspberry Pi 5 by account17 on Thursday November 16, 2023 @10:45PM (#38299250)
They only released the "large" model of both v2 and v3, the tiny model is v1