News for hackers. Stuff that matters.

A comment on Show HN: Alsa_rnnoise – RNNoise-based noise removal plugin for ALSA. Parent comment

Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by ArsenArsen on Sunday January 31, 2021 @07:32AM (#25978323)
The documentation is a bit poor. The original data is available for download (with more info about the entire process, most of which is outside of my grasp as I am not an ML person) in the demo blog post: https://jmvalin.ca/demo/rnnoise/ (towards the bottom of the page)
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by ArsenArsen on Sunday January 31, 2021 @01:40PM (#25981299)
Coming back with information from #xiph on freenode:

  16:57 <ArsenArsen> where and under what license is the training data used for RNNoise?
  18:38 <rillian> ArsenArsen: There's a copy of what I believe is the training data on the xiph server, but afaik it's never been published
  18:39 <rillian> the original submission page has an EULA waiving copyright and liability claims, and agreeing that it _may_ be released CC0.
  18:40 <rillian> it looks like that didn't actually happen.
  18:41 <rillian> there may have been concerns about auditing it for privacy issues, but there's a lot of audio to listen to, 6.5G compressed
  18:41 <rillian> jmspeex, TD-Linux: what's the status of publishing the rnnoise training data?
  18:43 <jmspeex> Are you talking about the data that was used to train the default RNNoise model or the noise that got collected with the demo?
  18:43 <rillian> jmspeex: I think debian just cares about the training data for the default model.
  18:44 <jmspeex> There was never plan to release that -- it includes data from databases we cannot release
  18:44 <jmspeex> but I don't see what the issue is. Distributing the model is not the same as distributing the data
  18:45 <rillian> ah, I see. I didn't realize you'd used proprietary sources as well.
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by pabs3 on Sunday January 31, 2021 @08:16AM (#25978566)
Any idea about the license for the original data?
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by pabs3 on Sunday January 31, 2021 @08:30AM (#25978667)
The paper links to the McGill TSP speech database (English & French) as one of the sources of the data, which claims to be BSD licensed:

http://www-mmsp.ece.mcgill.ca/Documents/Data/

[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by pabs3 on Sunday January 31, 2021 @08:32AM (#25978681)
The other source of data mentioned in the paper is the NTT Multi-Lingual Speech Database for Telephonometry, which seems to be commercial, so presumably under a proprietary license.

https://www.ntt-at.com/product/multilingual/ https://www.ntt-at.com/product/speech2002/

[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by pabs3 on Sunday January 31, 2021 @08:41AM (#25978741)
Hmm, OTOH, the 6.4GB data tarball says that it is from contributors who responded to the demo and is licensed under CC0.
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by ArsenArsen on Sunday January 31, 2021 @10:45AM (#25979590)
+1, that data is CC0, and I believe that's all the data that was used for training.
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by jmvalin on Sunday January 31, 2021 @03:38PM (#25982345)
No, exactly none of that data was used for training. The training was done before the demo that was asking for noise contributions. The contributions are CC0, but were never used (i.e. totally unknown dataset quality).
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by the-dude on Sunday January 31, 2021 @09:50AM (#25979213)
So far we have 3 ideas!
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by pabs3 on Sunday January 31, 2021 @08:20AM (#25978593)
Also any idea if the training required nvidia GPUs or was it done on CPUs or GPUs with non-proprietary drivers?
[ Parent | on HN ]
Re:Show HN: Alsa_rnnoise – RNNoise-based noise removal plugi... by ArsenArsen on Sunday January 31, 2021 @10:30AM (#25979492)
There is training instructions in the repository. The training scripts appear to be using some pretty standard ML libraries (I'm seeing keras and mentions of tensorflow), so I imagine that the requirements are the same as those.

I don't feel I'm qualified to elaborate on this specifically, again, I'm no ML person. For more info look here: https://github.com/xiph/rnnoise/tree/master/training https://github.com/xiph/rnnoise/blob/master/TRAINING-README

[ Parent | on HN ]