Voice2json: Offline speech and intent recognition on Linux

Re:Voice2json: Offline speech and intent recognition on Linux by wongarsu on Friday May 21, 2021 @01:52PM (#27237466)

That's fine for training your own model, but I don't think you could distribute the training set. That seems like a clear copyright violation, against one of the groups that cares most about copyright.

Maybe you could convince a couple of indie creators or state-run programs to licence their audio? But I'm not sure if negotiating that is more efficient than just recording a bit more audio, or promoting the project to get more volunteers.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by akiselev on Friday May 21, 2021 @02:03PM (#27237605)

It would likely be a lot easier for someone from within the BBC, CBC, PBS, or another public broadcaster to convince their employer to contribute to the models. These organizations often have accessibility mandates with real teeth and real costs implementing that mandate. The work of closed captioning, for example, can realistically be improved by excellent open source speech recognition and TTS models without handing all of the power over to Youtube and the like.

It would still be an uphill battle to convince them to hand over the training set but the legal department can likely be convinced if the data set they contribute back is heavily chopped up audio of the original content, especially if they have the originals before mixing. I imagine short audio files without any of the music, sound effects, or visual content are pretty much worthless as far as IP goes.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by dec0dedab0de on Friday May 21, 2021 @02:05PM (#27237636)

I'm not sure that is a clear copyright violation. Sure, at a glance it seems like a derivative work, but it may be altered enough that it is not. I believe that collages, and reference guides like cliff notes are both legal.

I think a bigger problem would be that the scripts, and even the closed captioning, rarely match the recorded audio 100%

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by Wowfunhappy on Friday May 21, 2021 @05:07PM (#27239980)

And also... it's not like the program actually contains a copy of the training data, right? The training data is a tool which is used to build a model.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by taneq on Friday May 21, 2021 @05:18PM (#27240083)

How is it different from things like GPT3 which (unless I’m mistaken) is trained on a giant web scrape? I thought they didn’t release the model out of concerns for what people would do with a general prose generator rather than any copyright concerns?

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by sodality2 on Friday May 21, 2021 @02:01PM (#27237575)

Does using copyrighted works to train a machine learning model make that model infringing?

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by wongarsu on Friday May 21, 2021 @02:37PM (#27238083)

Generally a ML model transforms the copyrighted material to the point where it isn't recognizable, so it should be treated as its own unrelated work that isn't infringing or derivative. But then you have e.g. GPT that is reproducing some (largeish) parts of the training set word-for-word, which might be infringing.

Also I don't think there have been any major court cases about this, so there's no clear precedent in either direction.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by visarga on Friday May 21, 2021 @06:01PM (#27240515)

> But then you have e.g. GPT that is reproducing some (largeish) parts of the training set word-for-word, which might be infringing.

Easy fix - keep a bloom filter of hashed ngrams ensuring you don't repeat more than N words from the training set.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by pabs3 on Saturday May 22, 2021 @01:23AM (#27243747)

There are some that say that the Google Books court case is precedent for ML model stuff, if you search back through my comment history you will find links.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by sodality2 on Friday May 21, 2021 @04:16PM (#27239347)

Thanks!

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by marcodiego on Friday May 21, 2021 @02:06PM (#27237652)

GP is not talking about the model but about the training data set.

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by sodality2 on Friday May 21, 2021 @02:13PM (#27237735)

I am aware, I'm asking if the model, however, is infringing. Surely you can't distribute them in a dataset but is training on copyrighted data legal, and can you distribute that model?

[ Parent | on HN ]

Re:Voice2json: Offline speech and intent recognition on Linux by _jal on Friday May 21, 2021 @05:23PM (#27240138)

All text written by a human in the US is automatically copyright the author. So if an engine trained on works under copyright is a derivative work, GPT3 and friends have serious problems.

[ Parent | on HN ]