Re:Common Voice – Mozilla's initiative to help teach machine...
by lunixbochs on Thursday October 17, 2019 @08:53PM
(#21287724)
I'm also using test sets to measure my models, including test sets from datasets I'm not training on. But I called it out because the real-world difference is _significant_ for this task, users with heavy accents previously couldn't say most mid-sized sentences without having to try again and "americanize" their voice for at least one of the words. With Common Voice mixed in, that wasn't the case.
Fair but statistical systems are also extremely susceptible to placebo. I would be curious what a test set shows.