News for hackers. Stuff that matters.
Re:How Google Meet's noise cancellation works by bigtones on Tuesday June 09, 2020 @01:41PM (#23468849)
I was not so impressed with this demo - especially when he was scrunching his potato chip packet, the degradation in his voice quality made it almost impossible to understand what he was saying and his voice sounded very synthesized and processed, and that's through a $200 Yeti professional microphone. Seems like some of the other noise cancellation technology options from Nvidia RTX and others are more effective.
Re:How Google Meet's noise cancellation works by crazygringo on Tuesday June 09, 2020 @01:53PM (#23468956)
Microphone quality has very little to do with it. Noise separation is just an incredibly hard problem, particularly when a noise is loud. Scrunching potato chips, there's no scenario where his voice won't become degraded unless you can isolate the scrunching sound separately (microphone beamforming can help here, but is still never perfect).

Running this economically on servers at scale in realtime, I consider this very impressive. I can't say how it compares with RTX, but I wonder if it has anything to do with the amount of computing resources that can be dedicated to it. A single expensive card dedicated to one audio stream, versus a single Google server than needs to process hundreds (thousands?) of audio streams.

Re:How Google Meet's noise cancellation works by dannyw on Wednesday June 10, 2020 @02:19AM (#23474484)
RTX Voice uses less than 10% of a 2060 (non-super)

Given how common voice communication is in our world, I am sure Google can build ASICs for this (if not just run it on TPUs), and get the marginal cost of vocal processing to be negligible.

Heck, they probably would just need to divert <5% the resources of Fuschia or any other of their "senior engineer retention" projects.

Re:How Google Meet's noise cancellation works by tgsovlerkhgsel on Wednesday June 10, 2020 @12:02AM (#23473798)
Does this run client or server side?
Re:How Google Meet's noise cancellation works by jack_pp on Tuesday June 09, 2020 @02:59PM (#23469593)
However that wasn't a realistic scenario, you are unlikely to talk while scrunching plastics, ideally you should get muted 100% when you do it.

Only way this could happen is if someone is standing 3 feet away from you and does it while you talk which would just be rude and probably be stopped by you immediately anyway.

I'm more curious how this could work in the metro or with a washing machine nearby

Re:How Google Meet's noise cancellation works by SquareWheel on Tuesday June 09, 2020 @01:48PM (#23468917)
Yeti microphones pick up everything. If anything it would make the test more difficult.
Re:How Google Meet's noise cancellation works by vkou on Tuesday June 09, 2020 @01:50PM (#23468930)
You are correct. The sound quality of Nvidia RTX is amazing, compared to this.

Unfortunately, you need a $400 graphics card, and >100 watts of power to run RTX...

Re:How Google Meet's noise cancellation works by sp332 on Tuesday June 09, 2020 @02:06PM (#23469080)
Unofficially, it's pretty easy to get it to run on non-RTX nvidia GPUs. https://www.pcgamer.com/nvidia-rtx-voice-performance/
Re:How Google Meet's noise cancellation works by bhauer on Tuesday June 09, 2020 @02:33PM (#23469321)
Not only that, but even when running RTX Voice on a GTX, the amount of GPU horsepower used is miniscule; it hardly even registers. The fans on my GTX 9-series GPU don't turn on when running RTX Voice.
Re:How Google Meet's noise cancellation works by bentcorner on Tuesday June 09, 2020 @03:37PM (#23470015)
+1. I'm using it on a 1060 and I've monitored sensors with OpenHardwareMonitor while RTX Voice is running. The only observable effect is that my GPU's clocks are turned up, there isn't even any significant load.