News for hackers. Stuff that matters.
Re:Police are requesting data from smart speakers by buzzerbetrayed on Monday October 05, 2020 @11:23AM (#24688541)
To my understanding, these smart speakers only phone home when you say the keyword, right? They aren't storing or sending everything they hear throughout the day. So the cases where this could be abused by police has to be small. Seems like it would likely be used to verify that someone was home when they said they were because they asked Alexa a question at that time.

In other words, I don't think Amazon ever receives the "wrongthink" Alexa hears, unless you say it directly to Alexa.

Re:Police are requesting data from smart speakers by kristopolous on Monday October 05, 2020 @11:29AM (#24688607)
I haven't seen evidence either way and I don't own one. It should be pretty easy I'd think. You can measure the traffic volume when nobody is there + 8 hours or so and when you're having lively conversation + 8 hours or so (in case there's some kind of delay)

I know lack of evidence doesn't mean it doesn't exist, but if that came up empty then it'd be hiding pretty good.

Although honestly I'd delay transmission until user interaction and then hide in that noise - it'd be the first thing I do.

Eh, look at the traffic anyway

Re:Police are requesting data from smart speakers by serial_dev on Monday October 05, 2020 @11:39AM (#24688707)
As you figured out, there would be many options to hide the "secret" calls. There is also no need to send these secret calls from all devices, it could be used only by a set of devices that are owned by "interesting" people. Assuming that is true, if a security researcher looked into things no longer proves anything.
Re:Police are requesting data from smart speakers by kristopolous on Monday October 05, 2020 @12:17PM (#24689092)
Sure but there's probably provable ways to look for hidden stuff as well unless they are sending empty data.

You can do multiple runs of feeding pre-recorded messages into say multiple speakers and do the trial over many days. Then on a series of other speakers you can do a robust sequence of pre-recorded conversations followed by the same pre-recorded messages at the same time and then do statistical analysis on traffic volume.

I just presume these things are listening to everything and recording everything. I think that should be the general assumption if you bring essentially an "internet microphone machine" into your home.

If not by the company who sold it to you then by 3rd party hackers, clever app developers, or some other group. Every marketer wants to know what their customers are saying in the privacy of their own home.

As a tangent I've long wanted to have fun with this ... start a campaign to start collectively talking about a ridiculous product (say a vacuum cleaner with elephant ears that flap in proportion to the amount of dirt it picks up) in private conversations and see if a company releases it by listening in. "There's significant consumer demand for the dumbo-vac!"

Re:Police are requesting data from smart speakers by endogui on Monday October 05, 2020 @12:51PM (#24689478)
> Sure but there's probably provable ways to look for hidden stuff as well unless they are sending empty data.

Isn't this equivalent to the halting problem? Even with source code, there is a chance the compiler was compromised. In practice, these devices are closed source, so you would need to verify all the possible code paths.

Moreover, we know that NSA coerced phone companies into exposing metadata. What is the probability NSA has not requested backdoors of Amazon, Google, and the like?

Re:Police are requesting data from smart speakers by kristopolous on Monday October 05, 2020 @01:05PM (#24689618)
I don't think it is however there is an unprovable element here in that it's difficult to prove absence. However, depending on implementation it may not very difficult to demonstrate presence! If you run the basic tests and there's clearly a substantial difference between the two you're done. If there isn't, you need to dig deeper.

This is just the nature of indirect observation. People in the natural sciences deal with this problem all the time.

Re:Police are requesting data from smart speakers by smolder on Monday October 05, 2020 @12:44PM (#24689403)
Apart from targeted spying being a thing, the keyword recording trigger is not so reliable that it acts as a good filter.

https://moniotrlab.ccis.neu.edu/smart-speakers-study-pets20/

Re:Police are requesting data from smart speakers by bleepblorp on Monday October 05, 2020 @02:34PM (#24690580)
Unless these devices have enough performance to do on-device speech recognition, they could have to stream audio on an ongoing basis.

I think the data stream from uploading compressed audio for an extended period would be difficult to hide.

Re:Police are requesting data from smart speakers by izacus on Monday October 05, 2020 @11:30AM (#24688615)
> To my understanding, these smart speakers only phone home when you say the keyword, right? They aren't storing or sending everything they hear throughout the day.

Yeah, but there are mistriggers as well - I think you should see them in myactivity.google.com with Assistant filter enabled.

Re:Police are requesting data from smart speakers by kps on Monday October 05, 2020 @12:41PM (#24689362)
At least for Google/Nest devices, you can turn on notification sounds.
Re:Police are requesting data from smart speakers by nitrogen on Monday October 05, 2020 @01:20PM (#24689770)
The hardware is still there, and all it takes is an exploit or a firmware update to disable notifications and enable recording.
Re:Police are requesting data from smart speakers by kps on Monday October 05, 2020 @03:41PM (#24691240)
The context is accidental triggers. A mass exploit would have millions of ISP cry out in terror as their upstream usage suddenly jumps.
Re:Police are requesting data from smart speakers by ffhhj on Monday October 05, 2020 @11:54AM (#24688858)
I.e. Apple contractors 'regularly hear confidential details' on Siri recordings:

https://www.theguardian.com/technology/2019/jul/26/apple-con...

Re:Police are requesting data from smart speakers by zepto on Monday October 05, 2020 @12:07PM (#24688997)
Not any more.
Re:Police are requesting data from smart speakers by eeZah7Ux on Monday October 05, 2020 @01:41PM (#24690029)
> To my understanding, these smart speakers only phone home when you say the keyword, right? They aren't storing or sending everything they hear throughout the day.

1) There has been various cases of such devices being triggered incorrectly and uploading chunks of recordings

2) It's all implemented in software. It's extremely easy for the vendor to enable more keywords or record for longer times.

3) It's impossible to prove that 2 is not happening already in limited cases

4) There is a proven long history of very effective global surveillance programs targeting every electronic device (phones, cell towers, carrier-grade routers, PCs, servers).

Re:Police are requesting data from smart speakers by hrktb on Monday October 05, 2020 @11:40AM (#24688713)
To echo izacus's comment, they are very sensible and there's dozens of variations of the keywords that they accept.

We have a Nest Hub, and saying Google twenty times a day was a deal breaker so we all use some other variation that works 99% of the time, and looking at history it accidentally triggers itself a few dozen more times during the day.

It has a real value for us for now, but privacy issues are real in my opinion.

Re:Police are requesting data from smart speakers by vanadium on Monday October 05, 2020 @12:17PM (#24689098)
I've taken a more cautious approach to assistants and only tend to use Alexa if it requires a physical keypress first, e.g., a Fire TV 4K rather than having bespoke Echo devices throughout the house. There's _some_ value on the home automation side of the offering until I can make everything closed-circuit around here.

The Google Mini that Spotify sent me, however, went straight into a pile.

Re:Police are requesting data from smart speakers by sib on Monday October 05, 2020 @07:20PM (#24693127)
>> To my understanding, these smart speakers only phone home when you say the keyword, right? They aren't storing or sending everything they hear throughout the day.

This is the intended behavior.

But - there is a non-zero rate of false positives (when the device detects something that it thinks is the wake word, but is not), in which case, the audio is streamed to the cloud. This audio could (should?) be used for model training to improve the future precision of wake word detection. But, it could also potentially end up being subpoenaed by a law enforcement agency.

Re:Police are requesting data from smart speakers by bigbubba on Monday October 05, 2020 @12:48PM (#24689449)
The wake-word is different in different regions/languages right? That suggests they either have special silicon for each language (unlikely) or it's programmable. Is it reprogrammable over-the-air? Even if it can't be given more than one wakeword, it could presumably be reprogrammed to use a very common word, like 'the.' When in this surveillance mode it would remain quiet unless you also said the traditional wake word.
Re:Police are requesting data from smart speakers by sib on Monday October 05, 2020 @07:21PM (#24693136)
Yes, there are multiple different wake words and they can be updated / reprogrammed via firmware updates.
Re:Police are requesting data from smart speakers by warkdarrior on Monday October 05, 2020 @01:41PM (#24690028)
There are some 7000+ languages in the world. Baking recognition for 7000+ words in silicon is not a huge task.
Re:Police are requesting data from smart speakers by bigbubba on Monday October 05, 2020 @02:04PM (#24690280)
I think it's unlikely that's what they actually did.
Re:Police are requesting data from smart speakers by qu4ku on Monday October 05, 2020 @12:36PM (#24689315)
The thing is it doesn't need to record anything (to spy on you).

Voice recognition is 'on' all the time as it needs to recognise 'keyword'. All you need then is simple transcription into text.

Re:Police are requesting data from smart speakers by alexlmiller on Monday October 05, 2020 @12:42PM (#24689372)
Yes but that's not records that they actually have. The reason you need a wake word is because that processing is done locally on the device, it's not until you say the wake word that it starts streaming the audio data to the central server for processing.

Its certainly possible for Amazon/Google/Whoever to send your device a firmware update that turns it into an always-on microphone, but it doesn't do that by default

Re:Police are requesting data from smart speakers by matthewmacleod on Monday October 05, 2020 @12:52PM (#24689483)
Voice recognition is 'on' all the time as it needs to recognise 'keyword'

Not to say it's not a concern, but that's not really how these devices work – at least in the Alexa case. They're just matching for a specific hotword, rather than constantly performing speech-to-text (which is computationally expensive and done remotely). Think of it more like Shazam or the other audio fingerprinting services – you don't have to actually transcribe the text to understand if a particular word has been heard.

Re:Police are requesting data from smart speakers by hammock on Monday October 05, 2020 @12:39PM (#24689346)
You think it is phoning home with transcriptions 24/7? My understanding is that this is probably inaccurate, and it only phones home when the on-board electronics recognize the wake word.
Re:Police are requesting data from smart speakers by rightbyte on Monday October 05, 2020 @12:46PM (#24689424)
How many kb of text do you speak per day? It is just gonna be noise compared to when the JS framework of the week is updated. Amazon and Google can hide that.
Re:Police are requesting data from smart speakers by bergstromm466 on Monday October 05, 2020 @11:26AM (#24688579)
> these smart speakers only phone home when you say the keyword, right?

Without it being open source, there's no guarantee though?

Re:Police are requesting data from smart speakers by TacticalTable on Monday October 05, 2020 @11:32AM (#24688633)
You can get a pretty good idea from power usage, storage, and internet usage. Unless there's multiple hidden revolutionary breakthroughs in speech transcription or compression, nothing unsavory is happening at scale.
Re:Police are requesting data from smart speakers by bergstromm466 on Monday October 05, 2020 @12:14PM (#24689063)
...most didn't know about the Intel ME chip. A designated onboard black-box chip for transcriptions, that doesn't rely on an a server, would seriously benefit tech corps

Would it really be the first time we were lied to/surveilled?

When will we stop giving the hyper-growth oriented Silicon Valley startup world the benefit of the doubt?

Re:Police are requesting data from smart speakers by dbuder on Monday October 05, 2020 @01:33PM (#24689938)
No, someone (Google I think) admitted that they collect more than the audio around recognised keywords because in order to use ML to improve their voice recognition they need the data. More than just false positives. But guess what, they have to have humans to determine that, so they have people sitting around listening to very concerning things (the article said suspected domestic violence) and then having PTSD from it.

And if one of them is doing it, they all are, they all think the same and have the same incentives. This entire play is about the data.

Re:Police are requesting data from smart speakers by hdjdbtbgwjsn on Monday October 05, 2020 @12:28PM (#24689216)
I'm fairly sure there have been multiple stories about smart speakers sending things they hear without the keywords.
Re:Police are requesting data from smart speakers by dang on Monday October 05, 2020 @05:57PM (#24692499)
Could you please stop creating accounts for every few comments you post? We ban accounts that do that. This is in the site guidelines: https://news.ycombinator.com/newsguidelines.html.

You needn't use your real name, of course, but for HN to be a community, users need some identity for other users to relate to. Otherwise we may as well have no usernames and no community, and that would be a different kind of forum. https://hn.algolia.com/?sort=byDate&dateRange=all&type=comme...