News for hackers. Stuff that matters.
Re:FFmpeg 8.0 adds Whisper support by bondarchuk on Wednesday August 13, 2025 @07:24AM (#44887115)
I don't understand how this would happen, though. It's not like it will mishear a dutch sentence as if it's english; it will correctly pick up the dutch sentence, but (since the language is auto-detected as english at the start of the segment), seemingly auto-translate that (correct and correctly heard) dutch text to english. All we need is a way to get the dutch text that's surely somewhere in there, before the translation happens.

Unless it was trained end-to-end on dutch-subtitled english text?? Which might make the translation a somewhat inextricable part of the model..? Does anyone know?

Re:FFmpeg 8.0 adds Whisper support by busup on Wednesday August 13, 2025 @09:06PM (#44895702)
Maybe try the turbo model which is transcription only. The other models were trained on x to en translations and they seem to emphasise the output language over the task token. You can get them to translate to any language even though it was never trained for that, comparatively nl-en translation is in the dataset so I'm not surprised it's doing that.
Re:FFmpeg 8.0 adds Whisper support by bondarchuk on Thursday August 14, 2025 @06:10AM (#44898716)
Hey, good tip, thanks a lot!