News for hackers. Stuff that matters.
Re:Facebook open-sources a speech-recognition system and a m... by darkpuma on Friday December 21, 2018 @04:03PM (#18736631)
Given the value of open source training data (or scarcity of it), has anybody attempted to use LibriVox for training?

https://en.wikipedia.org/wiki/LibriVox

https://librivox.org/

The recordings are public domain audio books of public domain books, so the licensing should be fine. The audio isn't annotated, but given the value involved I think it would be worth attempting to use forced alignment to annotate the recordings with their public domain source texts. Forced alignment using the sort of speech recognizer you're trying to train in the first place may be a bit "chicken and the egg", but from some experiments I've run myself existing open source speech recognizers can do it reasonably well. Humans could manually tune up the alignment to improve the quality if necessary.

As for motivating people to actually do that mundane work... well these are audio books so maybe the work isn't so mundane after all! The LibriVox recording of Tom Sawyer (read by John Greenman: https://librivox.org/tom-sawyer-by-mark-twain/) is pretty great and has been listened to by millions of people. If somebody created a "read along" web app that showed you the text of the book from Project Gutenberg getting highlighted as the audiobook from LibriVox was played, users who have an interest in reading/hearing the book could have their attention held by Mark Twain and with the right UI provide fine tuning for the forced alignment at the same time.

Re:Facebook open-sources a speech-recognition system and a m... by woodson on Friday December 21, 2018 @05:30PM (#18737279)
LibriVox recordings are what the LibriSpeech corpus [1, 2] is based on. That's what they use in the paper.

[1] Panayotov, V., Chen, G., Povey, D. and Khudanpur, S. (2015). LibriSpeech: an ASR corpus based on public domain audio books. Proc. ICASSP. http://www.danielpovey.com/files/2015_icassp_librispeech.pdf

[2] http://openslr.org/12/

Re:Facebook open-sources a speech-recognition system and a m... by lingz on Friday December 21, 2018 @04:22PM (#18736762)
Librivox is commonly used as a training corpus however it's main weakness is that reading speech differs quite a lot from conversational speech.
Re:Facebook open-sources a speech-recognition system and a m... by darkpuma on Friday December 21, 2018 @04:30PM (#18736826)
I see. I hadn't considered that might be a weakness because to be honest the creation of forced alignments between LibriVox and the source texts was my objective (it's a feature that exists on some Kindle's when pairing ebooks with audible audio books. I believe the feature makes literature more accessible, a noble enough cause. Although I can understand why more effort is being spent on recognizing conversational speech.)
Re:Facebook open-sources a speech-recognition system and a m... by gdy on Saturday December 22, 2018 @05:56AM (#18740052)