Re:Introducing Voice Isolator and Background Noise Remover
by mbrock on Thursday July 04, 2024 @07:07AM
(#40873927)
I've noticed it's necessary to cut long audio into sections, otherwise it starts getting confused and repeating itself. The output token limit only lets you transcribe a few pages at a time anyway.
I just started trying this today with my wife's hour long interviews in Latvian language and it is extremely good, far better than any transcription model. This is a huge SoTA LLM with audio tokens, so it just has vastly more capability than Whisper or whatever. In my case it nails all kinds of brand names, weird neologisms and loan words, it writes inline quotation marks when the speaker is quoting someone, and so on.
This is what GPT-4o supposedly can do in the version OpenAI has postponed rolling out.
If you want, I can try to do it for you if you send the audio.