News for hackers. Stuff that matters.
Re:Introducing Voice Isolator and Background Noise Remover by dbspin on Wednesday July 03, 2024 @05:45PM (#40870283)
I don't know about SOTA, but 'Adobe Podcast Studio' a web app that I believe is still free / in beta offers excellent sound cleanup. So much so that many podcast / radio producers I know no longer frequently use Izotope RX - one of the industry standard tools. Adobe are obviously horrendous, but if its for a one time use I'd give it a go. The feature you want is the 'enhance speech filter'.

https://podcast.adobe.com/enhance

Re:Introducing Voice Isolator and Background Noise Remover by wkcheng on Wednesday July 03, 2024 @06:03PM (#40870417)
This is really helpful, thanks! I have a bunch of audio that I need to clean up and this looks like it could fit the bill.

Do you know if there are any license issues with this? I don't see any license page--will they train/retain the recording?

Re:Introducing Voice Isolator and Background Noise Remover by dbspin on Thursday July 04, 2024 @06:22AM (#40873772)
I'm not sure - that's a really good question. I'd assume anything uploaded to a deep learning system retains the data for future training. But I have no information on the licensing of this tool specifically. Especially given the recent furore over Adobe's licensing terms.
Re:Introducing Voice Isolator and Background Noise Remover by echelon on Wednesday July 03, 2024 @06:11PM (#40870466)
STT: Whisper

TTS: GPTSOVITS / StyleTTS2

VTV: RVCv2

Open source isn't really doing a great job at voice, music, or video. It's managing to keep up in LLM and image spaces, but it's falling far behind in the multimedia department.