News for hackers. Stuff that matters.
Re:Distil-Whisper: distilled version of Whisper that is 6 ti... by worldsavior on Wednesday November 01, 2023 @05:43AM (#38096262)
If it's faster, why openai doesn't implement it?
Re:Distil-Whisper: distilled version of Whisper that is 6 ti... by MacsHeadroom on Wednesday November 01, 2023 @10:13AM (#38098441)
Because OpenAI focuses on putting out quality models. Efficient execution of ML models is another skill set entirely. Projects like CTranslate2 (which is what faster-whisper uses) are focused on fast model execution and work across all kinds of models from speech recognition to image and speech generation and everything in between.
Re:Distil-Whisper: distilled version of Whisper that is 6 ti... by HappMacDonald on Friday November 03, 2023 @09:32AM (#38128475)
Also because OpenAI benefits from a certain measure of inefficiency to prevent models from being easy for the masses to run without them being in the loop extracting money as well as compiling new training data out of every inference that users feed them.