Re:Mozilla Overhauls Speech-To-Text Contribution Interface
by archgoon on Sunday July 01, 2018 @10:02PM
(#17438859)
Well, download took longer than expected :).
Anyhow, here's a sample from the csv file:
filename,text,up_votes,down_votes,age,gender,accent,duration
cv-valid-test/sample-001224.mp3,but i felt miserable watching him wither away like a shriveled dandelion,1,0,thirties,male,england,
Not sure how some of these are being populated, but yeah; there's several additional folders including invalid mp3, a splintered train set (not sure how it was selected) and a test set folder.Here's the README.txt. Looks cool! Have happy hacky fun! :)
https://gist.github.com/cwgreene/f7f4df4ddcd9da017b9f4694b3f...
Interestingly; many of the 'invalid' mp3's are actually (mostly) correct. Listening to them is interesting to guess as to why they were downvoted.
Re:Mozilla Overhauls Speech-To-Text Contribution Interface
by punchingwater on Monday July 02, 2018 @04:45AM
(#17440176)
We also keep the README in the repo:
https://github.com/mozilla/voice-web/blob/master/docs/corpus...
Re:Mozilla Overhauls Speech-To-Text Contribution Interface
by archgoon on Monday July 02, 2018 @02:26PM
(#17444192)
Thanks! Couldn't find the source of the Readme in the zipfile. Can you talk about what the update process for this file is? How often is it updated? Is there a way to just download the new files? Is there a tarball script for this in the repo somewhere?
I see that you have instructions for s3, are the files actually backed in s3? Is it possible to download them with s3 (possibly using requester pays)?
Re:Mozilla Overhauls Speech-To-Text Contribution Interface
by punchingwater on Tuesday July 03, 2018 @04:35AM
(#17448458)
We have no plans to allow users to download the "raw" data from s3 (ie. before we perform the train/dev/test split). But we want to eventually build some tools to automate this. See here for some background:
https://discourse.mozilla.org/t/the-mozilla-guarantee-publis...
I'm downloading it now, I'll have an answer in a half hour. Does anyone know if there is a torrent for it?