News for hackers. Stuff that matters.
Re:Leon: Open-source, self-hosted personal assistant by spullara on Sunday September 04, 2022 @03:03PM (#32716523)
There aren't any good speech-to-text models that are open source. If you think there is one, please reply with a link. The cloud ones are far superior.
Re:Leon: Open-source, self-hosted personal assistant by fxtentacle on Sunday September 04, 2022 @06:02PM (#32718140)
I fully agree and I would love to change that. I mean my company already funded work in that direction... but I sadly predict that we won't have good open source real-time speech recognition anytime soon.

My napkin calculation is that you need about $100k for each attempt at training a Conformer-Transducer. There's a pre-trained NVIDIA model but it appears to have a bad choice of hyperparameters and performance is much worse than what one would expect based on research literature and I believe you're not allowed to execute it on non-NVIDIA hardware.

A skilled team will maybe need 5-10 attempts for discovering a good set of hyperparameters. So the price to create the AI model will likely be around $1 mio. But if you have such large expenses, you have to plan things as a business venture. And that means an open source release is highly unlikely.

(unless, of course, someone like stability.ai is happy to bankroll 200 A100 GPUs for a few months each per target language. In that case, please contact me)

Re:Leon: Open-source, self-hosted personal assistant by heliostatic on Sunday September 04, 2022 @10:07PM (#32719743)
Mozilla DeepSpeech is not bad, and supported by Mycroft: https://mycroft-ai.gitbook.io/docs/using-mycroft-ai/customiz...

You can contribute to improving it here, too: https://commonvoice.mozilla.org/en

Re:Leon: Open-source, self-hosted personal assistant by spullara on Sunday September 04, 2022 @10:22PM (#32719823)
It is terrible. Try it against any of the cloud providers. The problem is the lack of data.
Re:Leon: Open-source, self-hosted personal assistant by Louistiti on Monday September 05, 2022 @12:53AM (#32720663)
Leon was using Mozilla DeepSpeech before. But then we moved to Coqui STT instead.
Re:Leon: Open-source, self-hosted personal assistant by jjulius on Sunday September 04, 2022 @03:32PM (#32716825)
Right, and that's fine. The point is that if that's the case, it's incredibly disingenuous to say that you are in control of your own data if you use Leon.
Re:Leon: Open-source, self-hosted personal assistant by Louistiti on Monday September 05, 2022 @12:55AM (#32720680)
You can choose what voice solutions you want to use. So you can choose the ones that run offline (which are the default ones).
Re:Leon: Open-source, self-hosted personal assistant by prmoustache on Sunday September 04, 2022 @06:33PM (#32718386)
That doesn't make it right to lie.
Re:Leon: Open-source, self-hosted personal assistant by Louistiti on Monday September 05, 2022 @12:57AM (#32720695)
Where is the lie here? You are free to pick voice solutions, and the default ones are the ones that run offline. Your call.
Re:Leon: Open-source, self-hosted personal assistant by RussianCow on Sunday September 04, 2022 @04:44PM (#32717526)
I don’t think the open source ones need to be superior to the cloud ones, or even as good. If they come close enough for the most common, let’s say, 80% of use cases, that’s good enough for many people.
Re:Leon: Open-source, self-hosted personal assistant by fxtentacle on Sunday September 04, 2022 @05:51PM (#32718049)
Currently, they are like 5x the error rate, which is significantly worse.