News for hackers. Stuff that matters.
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by gok on Wednesday November 29, 2017 @05:30PM (#15811519)
This is super cool, but I'd be cautious about the usefulness of this data set.

Both this data set and LibriSpeech are read speech, where the speaker was prompted with a transcription and asked to say it out loud. In practice it's very rare that you're trying to transcribe speech that's already been transcribed. Speech patterns for computer-directed speech (e.g. for voice activated user interfaces) or human-to-human speech (e.g. for meeting transcription) are quite different.

Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by punchingwater on Wednesday November 29, 2017 @07:02PM (#15812104)
Yup, this is an excellent point. We have, and will continue to explore ways to allow Common Voice users to speak more organically (for instance by answering a question, or responding free-form to some other sort of prompt). The problem with this approach is that it requires an extra step, transcription, which at the scale we are trying to achieve is pretty costly in either money or time (ie. tedium for our users). Eventually we hope that speech engines can take care of the transcription part, but for now we need people.

That said, we will definitely be exploring ways to build in organic speech and perhaps transcriptions to the Common Voice app. This will solve another problem for us too, which is getting public domain material for people to read. Doing this obviously requires a much more complex user experience, and we have more work to figure out how to make something that people will want to use and contribute to. Stay tuned for that :)

On the flip side, we hope that these datasets, models, and the tools (ie. DeepSpeech) can get more people (researchers, start-ups, hobbyist) over the hump of building an MVP of something useful in voice. Once you have people using your products, collecting useful in-context voice data becomes much easier.

On that note, another approach we are working on is partnering with universities and socially-aware startups like MyCroft, SNIPS, and Mythic. Imagine if voice products in market allowed their users to opt-in to contributing their utterances to an open resource similar to Common Voice. Of course, sharing your voice publicly is not for everyone, or every product scenario. But it does work for some. And if we pool our resources, our hope is to indeed commoditize speech-to-text so that we can focus on more interesting challenges like building voice experiences people want to use. (For instance, could voice somehow be a "progressive enhancement" to the web?).

Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by visarga on Thursday November 30, 2017 @12:38AM (#15813733)
> could voice somehow be a "progressive enhancement" to the web?

I have created my own TamperMonkey plugin that adds TTS to web pages. It finds text, makes it clickable, and when a user clicks a word, it starts reading from there, highlighting text as it reads it, skipping menus and chrome. I find this helps me better focus on reading. Unfortunately I can only stand one single voice and it's been stagnating for years (Alex from Mac OS). Can't wait to hear the WaveNet voice Google has been threatening to give us.

Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by beagle3 on Friday December 01, 2017 @08:07AM (#15823542)
Is it available for the rest of us perchance?
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by seanmcdirmid on Thursday November 30, 2017 @04:07AM (#15814398)
A speech recognition researcher I knew spent some time at Eastern Washington university because they had a lot of transcribed Washington state proceedings, which was open access enough to go into his company’s speech corpus, I guess (I only found out because I mentioned my mom graduated from there). Anyways, these people turn over a lot of rocks to realize their huge corpuses (erm, corpi?).
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by woodson on Thursday November 30, 2017 @04:13AM (#15814428)
Whether that is “open access” enough for commercial use is an interesting question. I thought that the SCOTUS recordings, for example, can not be used for commercial applications, but that might be a restriction imposed by the organization that processes and publishes the data, not the proceedings themselves.
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by gok on Wednesday November 29, 2017 @08:23PM (#15812596)
Have you considered getting volunteers to transcribe permissively licensed video or podcasts?
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by peteretep on Thursday November 30, 2017 @12:17AM (#15813648)
One advantage of being the size / prestige of Mozilla is presumably organisations that are willing to license their content for free to Mozilla for this purpose?
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by tim-- on Wednesday November 29, 2017 @11:22PM (#15813454)
I was thinking earlier that maybe YouTube CC-licensed audio with manually entered subtitles might be a good source?

Though, most videos of decent length would only contain say three or four speakers, which is most definitely sub-optimal.

https://www.youtube.com/results?sp=EgYYAigBMAE%253D&search_q...

Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by nullc on Wednesday November 29, 2017 @11:31PM (#15813484)
The last time I checked Youtube's terms of service prohibit you from making use of the rights granted by the creative commons licenses on the content.
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by sitkack on Thursday November 30, 2017 @03:05AM (#15814137)
How so?
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by ace_of_spades on Thursday November 30, 2017 @03:18AM (#15814195)
Just had an idea... what about call center providers? They already collect speech data for training purposes and transcription could most likely help there!
Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by woodson on Thursday November 30, 2017 @03:25AM (#15814223)
They do, but privacy is a major concern.

The bigger problem is, of course, that you need speech data with (fairly) accurate transcripts for training ASR systems. These typically don't exist for call center calls.

Re:Initial Release of Mozilla’s Open Source Speech Recogniti... by aflinik on Thursday November 30, 2017 @04:25AM (#15814483)
Transcriptions are not really the issue here, the cost of freelance transcribers is relatively low. It is privacy that makes it so hard, most of the call center calls need to have some kind of user authentication, which means they would need to be anonymized prior to being transcribed and used as a training material.