So how does the phone + ad networks decide which words to prioritize to trigger which ads when?
So for this anecdote to be true, not only would the phone have to be listening, but the targeting algorithm would need to decide to actively exclude all the other audible triggers from that time period, and fill your limited ad impression inventory with the one phrase you were intentionally testing.
How would it do that? Especially if this is indeed an outlier one-off topic of conversation that you cover in a single sentence. There would not be contextual clues (like repetition over time) that might indicate you are actually “in market” for a pool fence.
To me this is the problem with these anecdotal tests. You understood that that was an important phrase in the context of ad targeting. But how did the automated ad system know it should serve you ads on that topic, and not one of the many other advertisable topics you talk about over the course of several days? Or that your phone hears over several days?
Not saying I agree that 'phones are listening to show us ads', but technically we have the capability for that to happen (sampling audio every X intervals and matching against a local database of keywords)
I think it is very easy to sneak a few (thousand) extra fingerprints in this database and do all kinds of tracking with it. All while the green microphone icon is disabled.
Why would “pool fencing” take up one of those valuable keyword slots on everyone’s phone?
And you’re going to see way less than 11k ads per day. Why would the ad server prioritize serving an ad for pool fencing (a phrase said once) over all the far more common topics a person talks about in a typical day, like movies, TV shows, food and drink, clothes, cars, consumer electronics, music, etc?
So showing that person an ad for pool fencing is a complete waste; they're never going to click it. If that's what an alleged audio targeting system does, it would make the ad network less profitable than just using the data they already have. So why would anyone build it that way?
I'm not saying it is or isn't happening but it wouldn't be hard.
The same way they analyze your email and web searches. Basically, statistics.
>To me this is the problem with these anecdotal tests. You understood that that was an important phrase in the context of ad targeting. But how did the automated ad system know it should serve you ads on that topic, and not one of the many other advertisable topics you talk about over the course of several days? Or that your phone hears over several days?
Buddy, so many people have witnessed this happening for at least 10 years and even done experiments at this point that it's common knowledge. I know for a fact that one of my friends now has a phone that is especially receptive to hearing me say things around it, because our conversation topics ALWAYS come up in my searches, ads, and feeds shortly after. Think about that. Someone else's phone sends data to a cloud that I never gave permission to. It then puts that together with data from MY phone about where I was (perhaps even the devices chirping at each other!). The aggregation happens within a week then I see relevant ads. I've seen this happen dozens of times. It's no coincidence.
As far as the article, I'm not even going to read it. It's got to be stupid. We know from leaks, reverse-engineering, and personal experience that this spying is going on. I question the source of this article, but I suppose we should never underestimate the lengths someone will go to in order to feel that they are smarter than the rest of us with our eyes open.
I would be VERY interested to hear details of those leaks and that reverse-engineering. I've only ever heard the personal anecdotes.
(If you'd read my article you would have seen this bit at the top: "Convincing people of this is basically impossible. It doesn’t matter how good your argument is, if someone has ever seen an ad that relates to their previous voice conversation they are likely convinced and there’s nothing you can do to talk them out of it.")
If companies are willing to track your every click and mouse movement, every footstep and slight movement you make with your phone even while you are asleep, build and bundle keyboard apps to capture what you type, monitor you with AI, etc., are you seriously surprised that they would not also listen to you? None of that stuff I just described is fiction. It's established tech that has been documented over time. The only reason it's not 100% illegal is because the EULA probably covers it.
I swear people who think they aren't listening when they can seem like people who would be shocked to learn that an armed carjacker might demand your wallet in addition to your car. Unreal...
Oh yeah one more tip. Try to use the data export feature from Google or Facebook. You might just be surprised what you find. I've heard of people finding recordings of private conversations picked up by Google devices. I personally found hundreds of Facebook messages and posts that I deleted with a tool, and aren't visible to anyone (OK maybe the messages make sense but not the posts).
That's what my article is about: it's about how I'm certain people will use this settled-out-of-court lawsuit as "evidence" that Apple are spying and targeting ads, but it's very clear that's not what was happening here.
Another one I forgot to mention: Google explicitly tracks your location history unless you turn it off, and you'd be foolish to think that they won't (or couldn't) save the data anyway. People have done experiments showing dramatic improvements in battery life using AOSP without Google telemetry and spyware.
The microphone thing is false. You can try the takeout feature (or equivalent) across multiple providers to confirm that.
I seriously don't trust anything on a very deep level. Like I said, I've seen too much evidence that these companies are run by snakes that can only be trusted in certain ways. You might not agree, and I'm not prepared to argue all that tonight (I keep hitting the comment rate limit anyway). Just try to remain skeptical both ways if you don't believe we're being spied on, ok?
No we don't. There isn't any of that. This is flat earthing for technophiles.
I think flat earthers are mostly trolls, just like people who deny this spying is happening. Maybe that's giving them too much credit though.
https://www.404media.co/heres-the-pitch-deck-for-active-list...
And nevermind the conspiratorial thinking required to believe whole teams of engineers are developing and maintaining this capability across several giant companies, but nobody ever puts it on a resume. Apparently the thousands of people working on this are all personally committed to complete secrecy, forever. Uh-uh.
Bro it doesn't matter how much evidence you provide people with that this IS happening. They usually won't accept it. If they do accept it, half the time they shrug it off with "I've got nothing to hide anyway" kind of cope.
I seriously think I'm arguing with employees of these companies on HN because all you people do is deny everything and smear people who talk about this stuff. I hate to break it to you, but conspiracies are real. Noticing that people are conspiring to do things that nobody likes is not unreasonable in any way.
Take a look at this for example: https://www.theverge.com/23293687/amazon-irobot-acquisition-...
Even simple ad systems are a huge privacy threat. Add to that audio, location, and even AI screen reading surveillance, and you're screwed.
>thousands of people working on this all personally committed to complete secrecy
Basically describes a LOT of government spying programs or horrific abuses that have happened, for instance.
Secrets can absolutely be held, and I wouldn't be surprised by even thousands of NDA'd engineers (who already have been doing this sort of thing for a loooong time) opting not to leak anything in a way that would be credible.
I'll reiterate that I'm skeptical of the overall conspiracy claims even though I usually believe in mass spying claims or institutions/corps/etc. being awful. I just think your argument there is pretty flawed, at least that aspect of it.
In fact, on why I'm skeptical: I just can't shake this profound sense that it's like the "Frequency Illusion" phenomenon that I've demonstrated to people while driving or walking outside.
Or more likely a mix of it with people also getting prompted with what they "want" in the first place by all the advertising and targeted media and their various search history data.
Really smart people have been working on these things at Google for decades and that’s barely scratching the surface of this nuanced discussion. CPU/GPU has only gotten faster and smaller with more RAM available and better power management across the board for mobile devices.
Anything is possible if there is money to be made and it’s not explicitly illegal or better they can pay the fines after making their 100x ROI.
Most people don’t speak, and aren’t around people talking to them, for more than a few minutes to hours in a day.
You just need to awake every few secs or mins to see if someone is speaking and go back to sleep if they’re not.
They could even pickup or recognize the second voiceprint ID and know it’s your best friend and wake up the audio recognition from ultra power saving mode or whatever. Literally anything is possible to make this is work.
If big tech isn’t doing this then it sounds like a huge startup idea worth $$$. I hope someone on here in the spirit of HN runs with it and blows the top off this topic once and for all if it’s monetizeable or expose the FAANG patent sharks that come out to play and silence them for infringing on their shady microphone tech.
If this targeting technique works and is feasible and legal and in demand by advertisers, why isn't there a competitive group of startups all trying to do it better than each other and sell the results?
Now the conspiracy theory has grown to include "dozens of companies compete at this, all of them secretively operating in a marketplace that is entirely invisible to the outside world."
AI.
That is entire premise of 'Nexis' from Yuval Harari.
Individualized bot driven surveillance .
https://www.theregister.com/2024/09/16/oracle_ai_mass_survei...
""Ellison declares Oracle all-in on AI mass surveillance, says it'll keep everyone in line
Cops to citizens will be 'on their best behavior because we're constantly recording and reporting'""
That was one of the points in the book. in 2017 or before, a surveillance state was limited by the number of people it takes to do the actual surveillance . Now AI increases the efficiency.
There is a couple months where he is on every podcast. Then he is gone again.
You know who else does this, every other author on the planet. When a book is coming out, then suddenly the authors are on every podcast or show, talk, debate, anything they can manage to get on. Its a blitz.
You know what else happens on a book tour, they tend to give a highlight of the book. They don't sit there reading off references and citations. They give a streamlined high level idea of what the book is about, but not all of it, because they want people to go buy it.
2) If the app detects a consumption-related trigger word, the related conversation is flagged for transmission to the server.
3) Flagged audio block is converted to text. Consumption related verbs ("buy", "purchase", etc) are identified. The syntax of the sentence clearly indicates which noun is the target of a given consumption-related verb ("new car", "pool fencing")
4) Serve related ads
Lots of people run network traffic sniffers to see what apps are doing. Lots of people decompile apps. Lots of people at companies leak details of bad things they are doing.
Why has nobody been able to demonstrate this beyond anecdotes about talking about swimming pools and then getting adverts for swimming pool stuff?
Unless we're talking about an electret capsule with a physical LED wired into the supplying power rail that is switched off when the mic is not in use, you have to trust software.
And good luck with that after the patriot act. I am not implying the NSA has a microphone backdoor, but if they had and someone abused it, how would you know about it?
Listening in for keywords and only send text/audio when keywords are spoken isn't only good for ads, that would be dream of any intelligence agency. And since Snowden have been a few years.
"Citizen four" by Edward Snowden.
Those chips do not log or transmit the audio they have access to.
edit: Having re-read my comment, I can see how it could easily be read to say "It's happening and this is how it works", whereas I intended to convey something like "It could easily be done and here's how." I have a bad habit of implying my point rather than stating it outright. I'm working on it!
If it were happening, it would kill our battery really quickly, and be easily measurable and obvious in a router trace, so I find it very unlikely.
In this situation, I was alerted to this because the assistant started responding. However, I've also been in situations where I tried deliberately to talk to the assistant and it failed silently. In those situations, the UI spawns the Assistant interaction dialog, listens to what I say and then just silently closes. Sometimes this happens if there's too much background noise, for instance, and it then just re-evaluates that it wasn't a valid query at all and exits. Sometimes some background process may be frozen. Who knows if this happens before or after sending the data to the server. Sometimes the dialog lingers, waiting for the next input, and sometimes it just shuts off, leaving me (annoyingly) to have to reopen the dialog.
Putting that together, I have no idea how many times the Google Assistant has activated in my pocket, gone live, recorded stuff, sent it to Google's servers, realized it wasn't a valid query, and shut off without alerting me. I've certainly seen the Assistant dialog randomly open when looking at my phone plenty of times, which is usually a good indicator that such a thing has happened. If it silently fails in such a way that the UI doesn't respawn, then I would have no idea at all.
The net effect is that Google gets a random sample from billions of random conversations from millions of people every time this thing unintentionally goes off. They have a clear explanation as to why they got it and why ads are being served in response afterward. They can even make the case that the system is functioning as intended - after all, it'd be unreasonable to expect no false positives, or program bugs, or whatever, right? They can even say it's the user's fault and that they need to tune the voice model better.
Regardless, none of this changes the net result, which is they get a random sample of your conversation from time to time and are allowed to do whatever with it that they would have done if you sent it on purpose.
Have you tried resisting an export from Google Takeout to see if there are answers in that data?
It's much better and safer to assume they are than they're not, especially because I've seen many many results which indicate they are.
That said, there's a much easier way to test this. Take two identical voice recognition smart devices (think Amazon Echos), register them each with a new never used Amazon account. Modify one of the devices to have a switch on its mic input which you leave off, and one which you leave on. See if the one with the mic on starts showing ads for things you've never searched for on that Amazon account. If the other one doesn't then there's your answer.
That sounds interesting enough that I might just give it a try.
It doesn't have to be your phone. Could be your TV or any other device.
Most importantly there's just patterns of behavior. Companies are absolutely desperate for every scrap of data they can get on you. Why would they not capture audio from your mic?
Occam's Razor and the answer to the question, "What kinds of companies are at work in the environment?" push that probability in a specific way, because the motives and means are definitely there. Do you think they are the kinds of companies that would waste such an opportunity?
Their Chief Councel's recommendation depends on how slimy they are, right?
What would happen if they got caught? Slap on the wrist would be all, if that, no?
This is absurd. The chances of rolling snake eyes twice in a row is 0.07%. However, that doesn't mean if I do get snake eyes back to back, I should think it's caused by "Technilogical causes" (aliens? CIA remotely controlling the dice?). At best, it's an incomplete argument. The power of the birthday paradox, along with the factors I explained in my previous comment means such occurrences are virtually guaranteed to occur if you're on the look out for them. This can't be dismissed with an off-hand with "Technilogical causes are much more likely than accidental causes for such effects to appear, in today's world".
>Occam's Razor and the answer to the question, "What kinds of companies are at work in the environment?" push that probability in a specific way, because the motives and means are definitely there. Do you think they are the kinds of companies that would waste such an opportunity?
Apple got sued for accidentally recording siri queries, and that cost them class action lawsuit, along with the requisite discovery. Some company intentionally doing this, all the while actively engaging in a conspiracy is far harder, and much easier to fall apart due.
No, more like Siri, bruh. To sell some too-expensive slippers. You used the word "absurd", didn't ya?
> accidentally recording siri queries
Sure. Apple does things by accident. Gotcha.
Motive, means, oppotunity. Which is missing?
The dice analogy is clearly a separate scenario than your guci slippers story, I'm not sure why you're trying to bring siri into that analogy. The point is that you can't just invoke "Technilogical causes are much more likely than accidental causes for such effects to appear, in today's world" without justification. If there's spooky stuff happening at a rate far higher than to be expected by pure chance, and there was proper documentation of this, I might be amenable to the above argument, but you haven't done that. In previous comments I listed multiple reasons issues with relying on random anecdotes, but you failed to rebut them.
>Sure. Apple does things by accident. Gotcha.
Is it really so unbelievable that automatic speech recognition would have false positives? There's plenty of things to criticize about Apple's behavior in that case (eg. not taking steps to ensure audio from accidental triggers are deleted), but the implication that they're intentionally doing it is totally unsupported.
>Motive, means, opportunity. Which is missing?
Proof that a crime has actually been committed. With that logic we should be arresting people for murder every time their ex/spouse goes missing, even if there's no evidence that foul play occurred. If it's been actually proven (ie. more rigorous evidence than random anecdotes) that people are getting targeted advertisements based on their conversations, maybe we can start assigning blame, but we haven't even established that's happening yet.
Bye.
> "The only clue that users seemingly had of Siri's alleged spying was eerily accurate targeted ads that appeared after they had just been talking about specific items like Air Jordans or brands like Olive Garden"
This is from William Gibson's BlueSky account.
Thanks for playing! "Accidentally"? You're either a rube or a shill. Either way, your karma points are quite an idictment of HN, dude.
> One Siri user said his private discussions with his doctor about a “brand name surgical treatment” caused him to receive targeted ads for that treatment, while two others said their discussions about Air Jordan sneakers, Pit Viper sunglasses and “Olive Garden” caused them to receive ads for those products.
The whole point of my article is that these random claims that were part of the original lawsuit in 2021 are being mindlessly quoted as if they are proven facts, when they are not. Here's my link again: https://simonwillison.net/2025/Jan/2/they-spy-on-you-but-not...
You think a company that builds iPhones in China in a building with nets to catch people who attempt suicide is doing this by accident?
It happened to my wife in realtime within the last year while I was in the room. You think they accidentally left it on? C'mon, man. I've got a bridge in Brooklyn to sell you; let me know, it's on sale just for you.
All some people care about is money, and they rule the top of this country, and probably damn near every other one, too. C'mon, man. Are you being naive on purpose, or is it just a side effect of your willful ignorance?
We did watch three Tom Papa stand-up shows on NYE, though. They were glorious; we were crying laughing. "Outrageous!" I love that guy, so brilliant, silly, and hilarious!
For the next week or so, I got many ads on my phone about underwater packages for Hawaii, along with ads for various snorkeling and swimming gear. Now I had never researched any of that on my phone, however obviously my brother has. And the ad trackers saw that both my phone and his had communicated out over the same IP address (my parents wifi) on other random internet connections, so that is probably why they were then targeting my tracker cookie with ads that would be related to his tracker cookie. (This is all technically "easy" for the trackers to do, and seems logical that they would, because "why not").
On an unrelated note, I was making a peanut butter sandwich, started browsing some sites, and started getting ads for Skippy peanut butter. My phone must have smelled the peanut butter in the air.
It was impressively creepy and a good way of surprising her with something she hadn't said anything about but was considering buying.
But, recently I started thinking about the average user, who will install anything and approve any permissions requested without reading it. And imperfect App Store reviews approving a Trojan horse accidentally.
Am I positive someone hasn’t inadvertently allowed mic access to a malicious party? I wonder if that person’s phone may, in fact, be listening to them.
Experiment design is important! I completely believe that this happened to your friends and I also don't think it means what you/they think it does
(That is: you need to completely isolate yourself; music practice room on a college campus where nobody is wearing a watch or phone and repeat the experiment. If it turns out that you still see ads for that thing, then the experiment didn't prove anything)
If you feel like repeating this experiment, try generating the phrase randomly rather than choosing one, to eliminate unconscious bias.
Did you know that you can set up a proxy from your phone and capture all traffic from it? It would be so trivial to find the traffic from your phone. There are ways to MITM and inspect the traffic, too.
There are also many people doing static reverse engineering of phone apps looking for security vulnerabilities. To believe this urban legend, you’d also have to believe that none of them have ever encountered this hidden voice analysis code.
If we ignore that, you know there are OS-level security controls on apps, right? iOS and Android don’t make it easy for apps to use the microphone constantly and run in the background to process it.
Finally, if we ignore all of that, how can anyone believe that these companies are recording conversations but none of their employees have ever chosen to blow the whistle? We’ve seen numerous FAANG “whistleblowers” come through with everything down to trivial or baseless complaints, but nobody has blown the whistle on these supposed widespread spying programs?
The whole urban legend is preposterous to anyone who has any experience with apps or phone security, let alone common traffic analysis or reverse engineering tools. I don’t understand why the myth is so persistent among even some technical people.
As for whistleblowing... Is there really that much to whistleblow about it? We already know that ad-based companies like Google are collecting our data every chance they get, because they make billions of dollars from it. They're scraping our emails, studying our GPS location, paying attention to who we are in proximity with, etc. The level of surveillance is incredible and people don't really care. It wouldn't be headline news to find out that they are taking advantage of yet another side channel.
The phone knows about your proxy. There are phones - actual brands - that were caught on sending secret telemetry to their manufacturer, but only when not listened - definitely only on mobile data, no wifi, and I assume with cert pinning.
I know a person who was researching this and they needed a Faraday cage and a BTS to conduct experiments. So it's not exactly trivial.
The difference is that these were small Chinese brands that were not even that popular in my country - and still someone researched this. Imagine how much research Android and Iphone get, and there's not a single proof of and wrongdoing. Now that is unlikely.
That's kind of the smoking gun when you can create a disjoint set of topics and a disjoint set of mediums of communication delivery and see what shows up in the ad space from those discussion topics strictly expressed verbally.
...unless there were actually several thousand people who performed this experiment, got a negative result, and therefore don't remember it or post anything about it.
Isn't the technical hurdle just changing the "Alexa" or "Siri" wake word into a keyword for an ad campaign?
It seems like users can have iphone listen to audio keywords, but I don't use Apple so I don't know the details. https://support.apple.com/guide/iphone/use-vocal-shortcuts-i...
Obviously an experimental advertising system would require a special deal with the phone manufacturer and would be covered by Apple's very broad license to advertise based on your data.
That doesn't mean they're doing it, of course. I'm just not aware of technical or legal barriers.
I was walking to work and my backpack zipper broke getting off the elevator. When I got to my cube I set my phone on the desk and said to my coworker, "damn, my backpack zipper just broke!" 45 minutes later I was in a meeting and checked my phone and backpack zipper ads appear. I had never googled backpack zippers before, never seen backpack zipper ads. Literally the only proceeding thing before getting these was was telling my coworker that mine had just broken.
Either they have the most technically impressive spying system that can't do anything right or it's just not happening and people are making connections where there isn't really any.
Having knowledge of the technical limitations and challenges myself, I used to be on board for this argument, but now less so.
All of the technical arguments against the listening seem to ignore the "Ok, <DEVICE>" or "Hello, <DEVICE>" initiating phrases for the voluntary surveillance devices people put in their rooms, and offer only a worst case defense ~"how could they process everything everyone is saying?!"
Why is it such a stretch to imagine these devices grab Direct Objects and Subjects and store those singular items for ad keywording?
We have cookies and know how they work, why is it difficult to extrapolate?
simonw is a breathless proselytizer of LLMs and likely is suffering from "a man's salary depending on misunderstanding" and all that.
It bears repeating, "these corpos are raising billions and hiring former alphabet heads to their boards for reasons other than just making you a better programming assistant."
How about because Apple say they don't do that, and can and do get sued if they say things like that which are not true?
(Sadly I make basically no money at all from my "breathless proselytizing" of LLMs. I hope to fix that this year, someone should pay me for this stuff!
You know I've written more negative things about LLMs than almost anyone else, right? 121 posts tagged AI ethics right here: https://simonwillison.net/tags/ai+ethics/ )
Who knows.
I'm just saying, the technical, ethical, and legal implications of creating an ad network that surreptitiously slurps up audio 24 hours a day in violation of the claimed terms of service without anybody leaking anything about it is a conspiracy that seems less likely than people just being more predictable than they would like to believe.
You might think the pool fencing example might be an extreme coincidence, but far weirder things happen every day. And what made your friend consider pool fencing as an example if they don't like pools? Maybe something they saw recently gave them the idea? Hmm...
We were watching it in Italian, our main language, and I wanted to know more about it, as I typed "g", the first result was "gatto siberiano", exactly the cat I was looking for. Way too specific.
Another time as my girlfriend said she was interested how much a specific model of a watch a friend of him costed, the very same happened, as I typed the first few letters the very watch brand and model appeared.
Since then, I just don't care about how much technical description I can read, nothing's gonna convince me of it being a coincidence.
Then theres the time a friend told me about a very specific brand of Ramen, I opened up Facebook, and there it was, very first ad.
However...
A friend tested the theory a few years ago. He doesn't own a swimming pool, doesn't want to, and has never expressed any desire to. He put his and his wife's phone on the table and said to the wife (loudly), "Why don't we look into pool fencing?". She agreed with him. Shortly after, on both of their phones, on a particular social network, they were inundated with ads for....pool fencing.