News for hackers. Stuff that matters.
Re:Coqui, a startup providing open speech tech for everyone by pabs3 on Wednesday April 14, 2021 @08:04PM (#26814682)
Check out the ML policy, it sounds like it would currently be classified as a "toxic candy" model due to the non-free data, but it sounds like you could re-train to avoid that.

Using CUDA also means it wouldn't be considered legitimately free enough, although folks are working on getting AMD ROCm into Debian.

Tensorflow isn't yet in Debian, but there may be folks working on it.

Another problem is that Debian doesn't have the hardware for doing training.

I'd encourage you to talk to the folks on the debian-ai mailing list and IRC channel to discuss these and other issues.

https://lists.debian.org/debian-ai/ ircs://irc.oftc.net/debian-ai

Re:Coqui, a startup providing open speech tech for everyone by donpark on Wednesday April 14, 2021 @11:44PM (#26815992)
AFAIK, using copyrighted data to train does not necessarily make the trained model "toxic". "Authors Guild, Inc. v. Google, Inc." case [1] is viewed as a key precedent for this view.

[1] https://en.wikipedia.org/wiki/Authors_Guild,_Inc._v._Google,....

Re:Coqui, a startup providing open speech tech for everyone by pabs3 on Thursday April 15, 2021 @01:20AM (#26816414)
The phrase is "toxic candy" not "toxic", see the policy for what it means.

Most data is protected by copyright, but I assume you meant proprietary rather than copyrighted. Using proprietary data might not matter under copyright law, but it does matter in terms of the Debian machine learning policy and DFSG, because the non-free data cannot be shipped in Debian main and thus cannot be used to train a model shipped in main.

Re:Coqui, a startup providing open speech tech for everyone by pabs3 on Thursday April 15, 2021 @01:25AM (#26816438)
Hmm, that case doesn't appear to be about ML though, could you explain how it is considered a precedent for ML?
Re:Coqui, a startup providing open speech tech for everyone by donpark on Friday April 16, 2021 @02:48PM (#26837605)
Re:Coqui, a startup providing open speech tech for everyone by pabs3 on Saturday April 17, 2021 @10:31PM (#26849325)
Thanks. Its interesting that this only applies to countries with the concept of fair use, which is unfortunately not widespread.
Re:Coqui, a startup providing open speech tech for everyone by ftyers on Wednesday April 14, 2021 @08:07PM (#26814699)
Yeah, ROCm is a bit of a mess. I actually have an AMD GPU in a server, but the drivers in the mainline kernel don't work properly, so have never been able to use it.

If I were into conspiracy theories I'd say that AMDs failure to compete in the GPU/DL space is to do with the relationship between the AMD CEO and the NVIDIA one.

Tensorflow is just awful, as is anything that touches bazel :)

Re:Coqui, a startup providing open speech tech for everyone by hansvm on Wednesday April 14, 2021 @09:51PM (#26815353)
> Tensorflow is just awful, as is anything that touches bazel :)

Mind if I ask why?

Re:Coqui, a startup providing open speech tech for everyone by ftyers on Wednesday April 14, 2021 @09:57PM (#26815385)
I wasted a week trying to replace the scorer component with a NN-based language model. Every time I made a change the whole codebase, including Tensorflow recompiled, so the turnaround time was about an hour per change. It was awful. I mean I get reproducible builds etc. and probably if you're running stuff at Google scale it has all kinds of useful features. But for development on a personal laptop it was torture. Eventually I gave up.
Re:Coqui, a startup providing open speech tech for everyone by hansvm on Wednesday April 14, 2021 @10:28PM (#26815561)
Got it, thank you.

Fwiw, that sounds like a bug or a misconfiguration; it's absolutely supposed to have better caching behavior than that (and does in the few projects I've used it on, even on a personal laptop). If you're interested in pursuing it further (I'd understand if you aren't; that sounds frustrating), I bet the bazel team would be interested in your report.