2) Your phone is doing the same thing except for it follows you around everywhere you go and records your map location, what apps you use, who you are talking to and what your web searches are. Your phone isn't recording just what you say...its recording what you do and where you do it and when you do it. It's overwhelmingly more pervasive and invasive if you value privacy.
3) The utility of being able to interact with a computer via my voice wildly surpasses the risk. Even if it had been my voice sent to this random other person all they would get is 3000 recordings of me saying "Alexa, what is the weight of an elephant?" "Alexa, play Magic Sword." "Alexa, whats the weather?" My father-in-law thought these things were the devil until he realized he could ask it to play ANY SONG HE WANTED and it would do it. Now he is always unplugging ours and plugging it back in on the porch so he can use it out there.
Literally every article about home assistants brings out a number of people who continue to say how they can't understand how people could have this in their homes. Great, you can't understand it. Meanwhile, an enormous number of people find immense utility in home assistants otherwise they wouldn't be proliferating so wildly for this long.
Point 2: My phone, an iPhone, offers a way to turn off the keyword-listening functionality - and presents this switch during initial setup. It also offers a way to turn off all tracking functionality. Apple has no financial gain from lying about this.
Point 3: This comes back to point 1. If you don't know what and when the assistant is listening to, you have no idea what phrases are being collected and shipped off. Also, there are plenty of studies floating about the internet about how "anonymized" search engine queries have been collected, studied, and in many cases paint very personal portraits of the people doing searches.
I know this isn't the kind of certainty you're looking for, but Google Home and Alexa both allow you to enable audio cues for when they start and stop recording. I find this helpful from an accessibility perspective, but the privacy-conscious may also appreciate the indicator.
The iPhone has a lot less tracking built in and has much better privacy controls than Android with Google Play Services, but there are still some avenues for different companies to track you and to have a lot of control over your device.
This is incorrect. If you want to know what your device has heard and processed (or failed to understand), you can look at the Alexa app on your phone. It will tell you what it thought you asked for and what it told you or played for you, and you can replay the recording of your voice request.
What I don't understand is why they have to store voice recordings instead of deleting them once they understand the vocal command. There could be a number of reasons and I don't like any of them.
They don't have to. You can disable it at https://myactivity.google.com
Google's always mining data behind the scenes and gapps are constantly phoning home, your "opt-out" preferences are meaningless.
That excuse made sense in a time where public trust in these companies was justifiably high but it's turned into a situation where the major tech giants have the power to become a modern day Stasi on steroids (and increasingly show their willingness to play that role). We had to place enormous trust in these company's ethics (mostly on a subconscious level as they all used to go to great lengths to afford us the ability to implicitly trust them) in order for the smartphone/mobile revolution to occur. Now that these devices are a necessity in modern society, they've all dropped the pretenses that allowed us to trust anything to do with the information they're collecting.
We're living in a cyberpunk dystopia and I don't see an easy way out.
Workaround:
1)Install F-Droid (f-droid.org) 2) Install Yalp Store from F-Droid
Not that I have any insider information but a while back someone made a post on reddit about what baffles them about their work and they had a job where they basically listened to very short voice clips and saw something on the screen and they had to decide whether it was the right word on the screen or not.
In case you weren’t joking.
It feels weird to feel out of touch. I’ve been a computer/technology enthusiast my whole life, and used to proudly early-adopt all sorts of crazy gadgetry. But the older I get, the fewer things coming out of Silicon Valley appeal to me, and the less I understand the use cases. I just have to shake my head and accept that they are somehow useful to a lot of people and that the idea of a cool useful product is changing.
* You have to have Amazon Music Unlimited which costs from $4.99 to $9.99 a month.
The fact that all the current listening assistants do ship the audio stream to the cloud has nothing to do with CPU power and everything to do with a desire to collect as much personal data as possible, and as far as I'm concerned they can pound sand.
Show me the source code!
...all of it, including what's running the entire cloud behind it! Until then, fuck no, no hot mics in my house. And actually then, still no hot mics unless I've plugged my Les Paul into my amp, in which case I switched them on.
2) My phone is a $12 throw away that speaks voice and sms (text).
3) Loose lips sink ships.
1- Apple might not be interested in listening to its users but I'm sure other businesses are. Apple users are loyal customers who can pay twice for a piece of technology and some of them will happily spend a night in line to be able to do that. Most advertisers would pay big money to Apple to know who those people are and what they want; that information is like gold.
2- unfortunately advertisers aren't the only entity potentially interested in spying people.
I think its laughable that this money would be tempting to Apple when they have a business that almost sees customers buying 700-1000 dollar plus devices on an annual or bi-annual subscription, especially when the privacy stance is one of the core pillars of the marketing message.
There is likely no commercially viable business model Apple could adopt to sell that data that would be remotely worth risking a 60-70 billion dollar a quarter in revenue money printing machine. That information is practically worthless in the context of iPhone revenue.
Should iPhone sales start to falter, this is absolutely something I would consider a concern, but the iPhone has a long way to fall.
I can imagine a system that throws an extra byte or 2 on those "chats" with the cell tower, or even abuses the timing that it decides to reach out and check the tower as the method of communication.
The actual voice recording and processing tech is small enough that it could be thrown right alongside the actual phone, for pretty cheap, and could run entirely separate from the phone itself, maybe even having its own battery!
Or not be sufficient in both cases.
Maybe that's just what they want you to think so you don't dig any deeper.
Carriers also keep records of where subscriber devices have been, so even if your phone doesn't have GPS, the carrier has cell tower triangulation logs of the device too.
ISPs such as comcast also save your browsing history to run their advertising networks, so that is also recorded somewhere too. And if/when net neutrality goes away completely, they might just sell that info too:
https://arstechnica.com/tech-policy/2017/03/comcast-we-wont-...
Whats even worse about ISPs doing it is how you usually have no other choices and it's your complete traffic stream!
Your assertion that "nobody can prove that" is rather absurd.
Also, there's no reason for Amazon to want a constant stream of Alexa data hitting their cloud services. The goal is to mine and extract valuable data about users to build profiles, ideally you'd want to do that on-device and send up the most valuable bits.
These are also capabilities they can silently introduce at anytime for any device.
Steve Gibsons "analysis" means nothing.
You guys are way to paranoid. They're a public company and they are constantly under audit. They have explicitly stated in their white papers that the device has two computers, one that just listens for the "Alexa" keyword that activates the other one for signal processing.
Do you really think they would lie on those white papers? The government would be so far up their ass with fines it would be ridiculous. Not to mention people have actually done tear downs of the device and you can see the two computers and monitor the power input to each one as it runs. The "dumb" computer with minimal memory would be having to store hours of speech data until you say the keyword so it can transmit to the other computer.
And yes, I am proudly paranoid. History and experience have confirmed the need for my paranoia for many decades.
You must not have suffered a SOX audit before. Part of the audit is technical.
Also, the SEC greatly frowns upon lying about your business.
Do you know of any published Amazon audits that describe in detail what specifically around Alexa is audited, if anything?
I almost think that the burden of proof that things aren't being sent is a valid expectation in this point. And that proof needs to be re-confirmed with each firmware update to ensure a bug hasn't caused the behavior to change.
All you need is 1 SS7 link and you can be any phone, kick anyone off a cell site, override call congestion and bump people off, change the display on your phone to any text, too many things to name.
Uh... packet analyzers, IP logs, bandwidth monitoring tools etc...
If instead of transmitting occasional bursts of data when you say the wake word it's been sending back tens of megabytes an hour, or tens to hundreds of megabytes a day, you can go "hey, it's probably transmitting everything it hears".
There are people that religiously watch what these devices are sending back just to try and catch one of the companies doing something fishy. There are people that religiously watch their network traffic period looking for something nefarious.
These devices aren't like your phone, where simply having it on can have all sorts of services/apps using data in the background or you open a webpage and tens or even hundreds of different servers are contacted and data pulled/pushed to/from them. It's a device that should be periodically checking for an update and sending very small audio files back in nearly-real time. If they were recording regularly, or especially all the time, and transmitting it back to a server it would stand out like a sore thumb.
Never mind the fact that keeping it secret, and not having a whistle blower, would be damn impossible. Someone's going to mention it to a loved one or friend, or flat out go online "I discovered my Amazon/Google device is actively listening and recording and sending to these IPs in these intervals" when they just know it as fact and didn't have to 'discover' it.
Here are some staring points. [1] I would go with Opus. My voice chat server uses that.
[1] - https://stackoverflow.com/questions/167533/best-voice-compre...
But at the same time, you're convinced that you would notice if your phone was slipping out these kilobytes as part of its usual communication?
It seems to me that you've just arbitrarily picked a level of paranoia where you've decided that this can definitely happen with the Alexa, but won't happen with your phone. Your proud paranoia isn't applied consistently.
The risk of the throw away device uploading my audio is significantly lower than a device powered in my home, with dedicated fast internet.
How?
Risks:
Willingly putting a proprietary device designed to listen to you and watch you, created by a company that exists only to maximize it's shareholders profits by either selling you things, advertising to you or collecting and selling data about you in order to do those first two things better, into your home to constantly watch and listen to everything that goes on.
Utility:
Control a computer by talking to it...
For me at least....that risk far outweighs whatever utility i migbt get by being able to speak to a computer and honestly, if i really needed it that bad i would just set up my computer with voice recognition and control software. It's existed for a while now. I remember playing with it when i was a kid...it sucked...but that was more than 15 years ago.
The only real novelty of alexa is that it'a a standalone box that answers you back.
Disclaimer: I'm a co-founder
We believe that people want more natural interaction and AI at home, but that it should never be at the cost of their privacy. You never know what a company, or hackers, could do with recordings from your home.
This is why we are creating AI which can work on a Raspberry Pi 3, and works in english, french, german, japanese, spanish, italian (more coming very soon)
Take a look at our blog if you want to build your own smart assistant: https://blog.snips.ai
Is this just a way to fundraise or do you have other ideas to make your product ‘decentralized’ aside from using a cryptocurrency?
For the record, everything else about the product looks amazing and I’m really excited to see an open and privacy conscience alternative in this space :)
- it allows to build a really decentralized marketplace - it allows people to not share what are the apps they are buying, so to keep this private
I'm only asking because this would definitely help spread this kind of platform. Raspberry 3, despite being great, is not something the average Joe will mess it.
There needs to be a physical product with Snip.ai on it that people can put in their home. Something sleek and well designed, not some Rasp 3 in a case with some mic attached with duct tape.
I agree that the decisions that me and others are making are hugely damaging collectively but that is a different issue.
Fear mongering is nothing new, folks. The media is incentivized to cater to people in that way; this is why they use scare tactics and write BS articles like this one which boil down to "someone fucked up, sent the data for one customer to another customer". Furthermore, the article implies this mixup would NEVER have happened if the user's had not requested their data be released per GPDR.
The only valid question worth asking is this: are you willing to risk ANY chance of your data being compromised? Google/Apple/et.al. are not the enemy. For most users, convenience trumps security, and they will accept the minimal risk that comes with using services like Alexa and Google Photos.
FWIW, I've lost years of photos and data before on my first run-a-round with FreeNAS. It's not something that's just easy for the average user or even average developer to use and deploy reliably. I'm trying FreeNAS again now 4 years later, but it's taken way more work than I expected to understand my options and ZFS, and I'm still not sure I'll ever store anything critical on it.
OK, cool. So as long as I don't assert my rights under data protection regulations, Amazon probably won't orchestrate a grotesque breach of my privacy?
We have to expect as users of cloud software there is a chance our data could be compromised by BUGS or human error. I think that should be a given in any scenario. There's a difference between releasing data to third parties (or internal employees having access) as a matter of standard practice, and an unexpected breach or error in process leading to accidental disclosure of personal data.
As a reader, I am uninterested in articles about the latter. It's clickbait / doomsday journalism. The most interesting stories are those about grave errors in judgment/behavior and cases that indicate a company has routinely breached user trust. I do not agree that "employee mistakes" fall in that category.
https://austingwalters.com/the-last-free-generation/
It's amazing to me that people are actively seeking to erode society as greatly as they are. The fact is, it's not better to have these systems long term. So what if it saves you even 10 minutes a day (which I highly doubt), if eventually someone comes to power that will decide to kill you and your families based on your prior beliefs.
Today we are seeing a more subtle manipulation of politics using all the data these large companies collect. I can't imagine what would happen if there was a concerted effort to "weed out" bad eggs.
If they can't see it they're fine with it.
For example, if someone is walking in the mall they're being filmed by a dozen cameras.
But if you walk behind them with your own handheld camera photographing them they will get VERY angry and freak out and start yelling at you.
Yet nothing has changed...
Same thing with Facebook. People don't mind giving their data to Facebook but if Zuck was staring over their shoulders reading their email they would be upset.
Now that I can use my Apple Music, they are used constantly.
Voice-first devices are long overdue.
Voice first running entirely on prem with no internet connectivity, sure I would go for that.
Talking to the internet? No way. Not even if I had root on the device with the source code to the OS, firmware and applications.
Can you explain how this is different from running your linux computer with a webcam attached?
I can also debug any code running on my machines and have some idea of what they are doing. I can also limit when they are allowed to talk to the internet and to what address.
Can't you debug code and control network access in that scenario?
For example: Nearly all cell phones check in to their manufactures website from time to time. Nearly all of them look for a header that triggers a debug mode that turns on CarrierIQ. (It isn't called this any more, AT&T renamed it to an empty name to stop people from searching for it).
Trying to find obscure functions and understand how they interact with the servers they check into can be very difficult at best. It often leads to more questions than answers, at least based on my experience.
In the meantime, I’m “feeding” my devices every day.
Hopefully voice-first becomes a solved problem, and you’ll get your device sooner.
I believe it was made by a company called Covox or something? There were several other companies that made similar software back then.
Certainly not as well as the software we implemented to listen to phone calls in the background on wireless networks in the mid 90's. That was the wildfire project and was fun. We abandoned it, since our lobbyists were able to kick the hands-free laws down the road.
Sure, that's not really anything that anyone disagrees with. It's the acceptance of data collection and exfiltration that is odd.
Everyone needs to draw a line somewhere, I just don't see a reason to use voice assistants, definitely not with internet connectivity and where the company keeps all recordings for some reason.
Google gives you a UI to view and delete your recordings and suddenly they're monsters.
To see exactly what outbound connections were made by which device and which app when either device was being actively used, or laying dormant?
This is how it was discovered in the UK that SmartTVs were sending viewing data....
The irony is the ability for mass survelence (by unelected corporations) is far more than they had in 1984
To be less baffled, think about how many of us have those devices under a different name: Our phone.
Functionally I do not see the decides any differently. Yet, I think everyone I know has an Ok Google, Hey Siri, or Ok Bigsbi (however you spell it lol).
I'm not going to lie, for some reason Alexa makes me more concerned than my phone. Yet, the logical part of me fails to see a meaningful difference between my phone and an Alexa.
Disclaimer: I own an iPhone, I do not own an Alex/HomePod/etc.
It's this thing where you somehow believe that just by being an expert in some field, bad things in this very field can't happen to you, even if it's out of your control. Like a brain surgeon suddenly getting a tumor in his own brain.
2) The chances of a mishap like this happening to a single user are very very small.
3) Even if a mishap like this occurs, the chances of it causing meaningful harm for most people are small.
The fact that you are baffled by this phenomenon says a lot more about you than it does about users of these products.
A good indicator of that is your reference of the Stasi.
I am baffled by people that think anyone cares about their conversation about Jeff at work or what Monica and Ross just did on the 75th viewing of an episode of friends, or that they talk to their stuffed rabbit named Bun that they've had since about a week after they were born about how miserable their life is and how they should just pack up and run away together... I mean...
"oh no, big bad google knows I shouted 'oi shut the fuck up' four times instead of three at the neighbors today" and "oh no, Amazon knows I asked what we want for dinner"
I guess I must be weird and other people are having extremely sensitive, if not classified, conversations in their residence but I just don't see what the big deal is.
Most of the people I personally know that find it bizarre people would have such a device have rewards cards, smart phones, take every damn quiz that myspace and facebook have ever had, checked in religiously with foursquare, tag their friends in every photo they upload seven times a day from every place they've been that day, check in everywhere they go on facebook and have 2+ streaming services monitoring every single thing they watch. Like, hellloooooo you're worried about a microphone that can't even get "hey alexa" "hey google" right half the time and actually trigger?
Why people object to have e.g. their financial or medical information disclosed?
Yes, there are people who are "sheep" in the sense that they would do anything if there is some voucher or discount for it. But most people would also object to a camera in their bedroom or photos of their kids being posted publicly online for everyone to see.
You are right that most of the stuff is absolutely mundane, especially in isolation. However, with a bit of analysis one could suddenly learn things about you that you would likely want to keep private - e.g. your sexual fetishes, whether or not you have some illness (insurers and some employers would kill for such info!), your political views, ton of data about your interests, which TV shows you are watching, etc. That's an absolute bonanza of data that makes any marketer salivate and see dollar signs. And a gold mine for all sorts of stalkers and creeps too.
People are not up in arms. Some group of media and tech people are up in arms. Most do not care. Heck, most do not even hear about the latest scandal.
Who? Leo Laporte? Kara Swisher? Talking heads on cable news? It's their job to be shocked and outraged.
Who is? Outside of HN I haven't heard a single thing about it. People don't care.
What's baffling is how many times this same conversation has played out and people like you still don't get it.
I grew up in an Eastern Europe Communist State where this kind of personal surveillance was the norm. People went and wrote down all their interactions with others. You can see these documents now as the former secret police archives were published (what wasn't destroyed to protect the higher ups).
It's amazing how the most innocuous remarks can be used against yourself in an unbelivable twists. Just an example: Person A criticized person C, which was his boss, as being incompetent, to person B, which was a secretly delator. Person B went and reported to the secret police this tension, as he was payed on the number of pages he would write.
The secret police compiled a weekly report of stuff that would happen, in each company, and send it up to the party for review. It just happened in the party that somebody who saw the report had frictions with that Boss, and he used that report to push the Boss around. The Boss thought that person A himself wrote the report, and used his connections to get person A fired, and banned, on the party line, from ever having a qualified-work position again - ie he could not be an engineer, teacher, or anything, leaving him with just construction work or janitorial jobs.
How often do you bitch about your boss? How would you like that your boss gets reports about what you bitch about him in your own home? How would you like that what you say, no matter how private you want it to be, is always recorded?
I'm astounded by the fact that people see nothing wrong having these devices always listening to them.
>I grew up in an Eastern Europe Communist State where this kind of personal surveillance was the norm.
Do you feel the same about smartphones? They record location, are capable of recording audio and video, if you have wifi and/or bluetooth on they can record every device ID you come within range of, they can in theory record everything you do in every app you use.
Don't get me wrong, I recognize the surveillance value/implications of such devices. As Pokemon Go was starting to initially gain popularity I even wrote a piece showing how such an app would be extremely useful as a tool for HUMINT.
TLDR: You create a game location, like a gym, in an area you want to surveil or deploy a rare spawn in a location you want to surveil. You then sprinkle it out on social media geo-targeting, then people flock to the area with their app that already chew through data and point their phone's camera all around the area giving you video and audio that you can either pull in real time at a risky data-cost or grab still images and then decide if you want to compress captured video and send it or leave it uncompressed and upload when the device connects to WiFi next.
Here's the post https://www.ryanmercer.com/ryansthoughts/2016/7/11/pokmon-go... and please, 'pokemon go funded by the CIA' was not something I believe then or now but there is a direct connection to the U.S. intelligence community via funding John Hanke received for a previous company.
That kind of sounds like a self inflicted wound if they actually cared about privacy.
This is all said with the presumption that the devices actually are surreptitiously recording. Which is far from proven but already addressed by other comments here.
I even used the example of a phone recording you being bad because that wasn't the primary purpose of the device when bought. That argument obviously applies to laptops for the same reason.
But if you as a consumer decide to buy a device who's literal only purpose is to record you, then you don't also get to cry out about it recording you. That's the very definition of a self inflicted wound.
Some are considered tech people who should know stuff like this could happen, but they just don't care or don't think it will happen to them.
Somewhere there is an ex-Stasi officer who is thinking "I wish we were that good and had people fooled to voluntarily install listening devices and didn't have to tap phone lines and crawl around basements and rooftops".