News for hackers. Stuff that matters.
Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by jedberg on Friday December 15, 2023 @02:43PM (#38657933)
A year ago I would have said it's impossible for ads companies to listen to everything you say and then base ads on it, because the sheer amount of data and compute necessary wouldn't be worth it, since 99% of what you say is useless garbage to them.

But today there are some pretty good local speech recognition models. I don't know if it's happening today, but I wouldn't be surprised if ad companies start figuring out ways to do local speech processing and only send the most relevant bits for full processing in the near future.

We'll have to depend on Apple and Google to protect us.

Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by RajT88 on Friday December 15, 2023 @02:47PM (#38657978)
> We'll have to depend on Apple and Google to protect us.

Wellp, we're boned.

Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by dumbfounder on Friday December 15, 2023 @02:51PM (#38658023)
Yep, if you can think of a feasible way to do it, you know it will be done. Local filtering makes it totally feasible. The real question is whether the OS is preventing this type of passive access to the microphone.
Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by ldarby on Saturday December 16, 2023 @10:41AM (#38664997)
I'm sure it's existed for many years. Ultrasonic tracking apps are from 2015: https://en.wikipedia.org/wiki/Cross-device_tracking#Applicat...

Let's try to imagine a world where that exists, keyword detection exists as well ("ok google" etc), and keyword detection for targeted ads doesn't exist. Can you? I can't.

Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by jedberg on Saturday December 16, 2023 @12:23PM (#38666000)
I can because I've worked in the space. You have to build a model for every key word that you are looking for. Those models take up space and lots of compute to train. That's why you can't set an arbitrary wake word for your Alexa/Google/Siri and you have to choose from a short list. Because those are the only models they have trained.

It would not make sense to train a model for every advertiser and then upload that to the phone. It would only make sense to capture the audio and send it to the cloud for generic speech processing. But that would also not make sense because it takes a bunch of compute to do speech processing, not to mention you'd see all the data being uploaded from your device and the cost of receiving, processing, and storing all that data.

I'm 99.9% sure that this is not happening today, but we are on the verge of the tech being good enough to do local speech processing, and then there is no bandwidth limitations, no storage issue, and the consumer pays for compute.

Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by ldarby on Sunday December 17, 2023 @10:15AM (#38673377)
> It would not make sense to train a model for every advertiser and then upload that to the phone.

I was assuming that's what they were doing. Maybe you could combine both ways, with really imprecise models, so the phone captures and upload only words that above average chance of matching (so not that much data), and have heavy servers do the rest?

Yes I don't work in this field, but you shouldn't assume that just because you don't know how something can be achieved, then no one else has figured it out either (especially where they're motivated to keep it secret).

Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by g-b-r on Monday December 18, 2023 @03:41PM (#38687915)
Only for very reliable recognition you'd need that, rough local speech recognition has existed for decades.

Here's a very basic offline app for Android: https://f-droid.org/packages/org.stypox.dicio . It works pretty bad for me, with its tiny not specialized models, but still enough for some purposes.

You can use an online model for the confirmation of the recognitions, by the way

Re:Ad Company Claims 'It's True. Your Devices Are Listening ... by g-b-r on Monday December 18, 2023 @03:57PM (#38688148)