News for hackers. Stuff that matters.
Re:Linux Audio Noise suppression using deep filtering in Rust by rektide on Tuesday June 06, 2023 @09:49PM (#36221782)
It's so excellent how many moats are just getting obliterated.

I absolutely have been a real snarky hater against AI, as a horrible fuedal unobservable black box that has way too much power in the world. But open source has been doing amazing at reading the papers & reproducing & it's glorious to see.

Amazing examples of a peership culture in action. Rising each other up is so divine. Share the knowledge & means.

Re:Linux Audio Noise suppression using deep filtering in Rust by philipkglass on Tuesday June 06, 2023 @10:01PM (#36221892)
I recently replaced an image classification pipeline that leaned heavily on classical computer vision techniques (like you'd find in OpenCV) with a neural network based approach using open models. There were about 4 years of developer effort invested in that old pipeline and I got better results with 2 months of effort invested in the new NN based system.

Later this year I plan on revamping an old NLP system with even more man-years of effort invested in it. I think I can beat it with neural networks too. The main reason I haven't started already is that open language model progress is so fast that I expect significantly better building blocks in 4 months. Using these new tools feels magical, particularly when you have experienced how much effort it took to get half-as-good results with older techniques.

Re:Linux Audio Noise suppression using deep filtering in Rust by Fordec on Tuesday June 06, 2023 @10:44PM (#36222222)
Any NN tips? I have my legacy pipelines, but haven't put the effort to migrate yet even though I know I should.
Re:Linux Audio Noise suppression using deep filtering in Rust by lettergram on Wednesday June 07, 2023 @12:49AM (#36222962)
Isolate the prior logic into functional components. Find the inputs and outputs to each box. Identify which component ML can replace. Replace one after the next, sometimes merging if the ML can do it all on the gpu
Re:Linux Audio Noise suppression using deep filtering in Rust by chintler on Wednesday June 07, 2023 @12:55AM (#36222996)
I've modernized a lot of legacy pipelines and can help you if you want.
Re:Linux Audio Noise suppression using deep filtering in Rust by philipkglass on Wednesday June 07, 2023 @01:01AM (#36223034)
The ML/DL software ecosystem is dominated by Python. Python's dependency management can be especially tricky, so try to limit the dependencies you're pulling in for the final deployed artifact if your final artifact is also Python based.

CUDA can be difficult to set up correctly on your personal development machine and if you rely on it you're also limiting the development machines that other people can use. You're limiting the deployment options and the CI options. This may differ if you work at a larger company that has a team specializing in these things, but I had to work out everything from initial proof-of-concept to final deployment. Some applications absolutely need the higher performance from GPU execution but it's worth seeing if you can get away with CPU-only execution because it avoids operational complications.

I used the ONNX runtime (as this DeepFilterNet project does, indirectly, according to a top level comment by WiSaGaN) and I was able to get adequate inference speed running on plain CPU. It's a small Python service that just wraps the inference logic with a command interface and a connection to Redis. It takes protocol buffer inputs from a Redis based queue, does a little bit of control logic followed by inference, and writes the results as protocol buffers to another Redis based queue.

The only ML libraries I have on the Python side are the ones for ONNX. This saved over a gigabyte (!) of transitive dependencies compared to the first proof-of-concept I had that relied on PyTorch for runtime inference.

Final advice: you actually don't need to know much theory to start doing something useful. I hadn't studied neural networks since graduate school 20 years ago so my theory is hopelessly outdated. I just started hacking together a little demo for myself and it was good enough that I was encouraged to take it all the way to production.

Re:Linux Audio Noise suppression using deep filtering in Rust by aurbano on Wednesday June 07, 2023 @06:29AM (#36225076)
We recently migrated to Poetry [1] for dependency management and so far it's been a breath of fresh air - it feels like what Python deps should've always been!

You can even have dependency groups, to separate main/dev dependencies for instance. It also brings env management, and plays very nicely with Docker if you use containers.

[1] https://python-poetry.org

Re:Linux Audio Noise suppression using deep filtering in Rust by KRAKRISMOTT on Wednesday June 07, 2023 @07:53AM (#36225671)
Good luck using poetry for GPU accelerated ML dependencies
Re:Linux Audio Noise suppression using deep filtering in Rust by nurettin on Thursday June 08, 2023 @12:57AM (#36237401)
poetry add maps to pip install, and you can get cuda based modules with pip, so what's the problem?
Re:Linux Audio Noise suppression using deep filtering in Rust by KRAKRISMOTT on Thursday June 08, 2023 @02:08AM (#36237880)
It doesn't support the -f option of Pip, which is non-standard but used by many ML dependencies.
Re:Linux Audio Noise suppression using deep filtering in Rust by nurettin on Thursday June 08, 2023 @11:04AM (#36243065)
you mean like this?

    wtf = { file = "omg.whl" }
Re:Linux Audio Noise suppression using deep filtering in Rust by KRAKRISMOTT on Friday June 09, 2023 @03:43AM (#36254615)
It's not reasonable to expect the end user to figure out the correct toolchain triple URL there are so many os-driver-framework version combinations.

https://download.pytorch.org/whl/torch/

It's meant to be an automated process, don't make excuses for poor implementation on behalf of Poetry.

See for yourself the number of torch related issues:

https://github.com/python-poetry/poetry/issues?q=is%3Aissue+...

https://github.com/python-poetry/poetry/issues?q=is%3Aissue+...

Not a week goes by without a new issue popping up. A dependency manager is a critical piece of infrastructure, it should not be the main developer experience bottleneck when building an application. A good package manager is out of sight, out of mind. You don't hear people complaining so much about Cargo every day.

Re:Linux Audio Noise suppression using deep filtering in Rust by nurettin on Thursday June 15, 2023 @08:36AM (#36339576)
I don't really feel like defending poetry, I don't even use it. But in this particular case, I think the wheel format and the way people try to host it on their servers and the entitled researchers who act like 80 year olds and "just want things done" instead of taking a little bit of time to learn to work with their tools are to blame. None of this exists with the cargo infra.
Re:Linux Audio Noise suppression using deep filtering in Rust by rektide on Wednesday June 07, 2023 @10:56AM (#36227585)
Poetry doesn't really work well if you try to ssh in. It tries to setup a keyring for some reason whenever you use it, but even if just to Runa project. I feel like it shouldn't be that hard to get going, but after trying to hack it for four hour I used a workaround of telling the keyrings to use a null provider & then was able to download deps & run the project I'd downloaded.

Admittedly only a single nit but it was still one of thr saddest most frustrating python experiences I've ever had.

Re:Linux Audio Noise suppression using deep filtering in Rust by chaxor on Tuesday June 06, 2023 @11:16PM (#36222434)
To quote Lukaz Kaiser in his famous talk on 2017: "stupidity is all you need"
Re:Linux Audio Noise suppression using deep filtering in Rust by est31 on Tuesday June 06, 2023 @10:21PM (#36222057)
Note that this isn't just a paper reproduction but a new paper in and of itself (the github is by one of the paper's authors). This is unbelievably amazing. I wonder how it compares to rnnoise, which is also open source and also targets real time settings.
Re:Linux Audio Noise suppression using deep filtering in Rust by atoav on Wednesday June 07, 2023 @02:52AM (#36223709)
As someone who worked professionally using top of the line audio denoising for speech in cinema productions I have to say that I am underwhelmed by the results. This is very similar to what traditional algorithms would have achieved a decade ago.

Of course there might be potential for improvement there, maybe it is more performant or was developed way faster etc. But just listening to the audible result is not too cinvincing — yet.