News for hackers. Stuff that matters.
Re:Google speakers are listening to more than just voice com... by chaboud on Saturday August 08, 2020 @11:17AM (#24092276)
It’s easy enough to test, but I don’t really need to.

Alexa Guard has had this functionality for a while, and I’d expect the folks here at HN to be able to infer a few things from the support link and basic reasoning.

Support link https://support.ring.com/hc/en-us/articles/360028205592-Usin...

So: 1) if an event is detected, you can listen to a 10 second clip or drop in (2-way call) to listen in or look. 2) Echo devices have relatively small amounts of RAM 3) Echo devices aren’t constantly hammering WiFi connections

From this, one should be able to deduce that the wakeword engine detects events and streams clips to servers only in situations that match events and settings to support these features. Why? Because processing, transit, and storage aren’t free, and one can’t store data in RAM that isn’t there or transmit data over WiFi without the physical layer showing signs of it. Furthermore, Amazon hasn’t cracked the code on hyper-efficient GB into KB lossless compression only to squirrel it away only for use in voice assistants.

Take the number of Alexa devices sold and run the numbers for all of those devices sending audio data to AWS all the time. The costs would be astronomical. The same goes for Google (though not with AWS). They’re no doubt incorporating the detectors into their on-device models.

Re:Google speakers are listening to more than just voice com... by MiroF on Saturday August 08, 2020 @01:37PM (#24093488)
Why can't they just have full on-device transcription models? It's lossy, but extremely compressed.
Re:Google speakers are listening to more than just voice com... by jankiehodgpodge on Saturday August 08, 2020 @06:14PM (#24095674)
Because they're cheap, low powered devices.
Re:Google speakers are listening to more than just voice com... by MiroF on Saturday August 08, 2020 @09:38PM (#24096608)
Even cheap devices can run transcription inference.
Re:Google speakers are listening to more than just voice com... by econcon on Saturday August 08, 2020 @11:32AM (#24092394)
> Furthermore, Amazon hasn’t cracked the code on hyper-efficient GB into KB lossless

I thought kbg archiver solved it eons ago.

Re:Google speakers are listening to more than just voice com... by jdc on Saturday August 08, 2020 @11:42AM (#24092478)
Nope, its high compression comes at the cost of similarly high CPU and memory usage.
Re:Google speakers are listening to more than just voice com... by nitrogen on Saturday August 08, 2020 @11:55AM (#24092578)
Compressed audio at speech quality uses miniscule amounts of storage, especially with modern codecs like Opus.
Re:Google speakers are listening to more than just voice com... by ineedasername on Saturday August 08, 2020 @12:51PM (#24093065)
You addressed storage but skipped the CPU portion: Yes, Opus can create good quality audio with low storage requirements, but it cannot do so without a high CPU cost.
Re:Google speakers are listening to more than just voice com... by AsyncAwait on Saturday August 08, 2020 @01:27PM (#24093395)
ARM CPUs can be rather performant, especially for specialist tasks. These things are always plugged in and don't need to save battery, therefore they can always run at maximum performance.

The HomePod for example uses the Apple A8 chip which is a very capable chip used to power the iPhone 6 than did way more than encode/decode audio.

Re:Google speakers are listening to more than just voice com... by fuzxi on Saturday August 08, 2020 @07:02PM (#24095926)
Wouldn't heat generation start to become an issue? As far as I know, none of these assistants have fans. I think the average consumer would notice that their device starts giving off a lot of heat if there's a lot of speech in range of its microphone - "I wonder why my Echo turns into a space heater when I leave the TV on."
Re:Google speakers are listening to more than just voice com... by AsyncAwait on Sunday August 09, 2020 @06:03AM (#24098512)
> I think the average consumer would notice that their device starts giving off a lot of heat if there's a lot of speech in range of its microphone.

Interesting point, my guess would be that not many would notice since a HomePod/Alexa/Google Home would usually sit somewhere in a corner of a room/under the TV and not be regularly touched since you don't need to touch it to control it most of the time.

I am not even sure it would be that much heat, my x86 laptop can play video for a very long amount of time before getting noticeably hot, granted with a fan, however these ARM CPUs get noticeably less hot than your average Intel chip, even without a fan.

Re:Google speakers are listening to more than just voice com... by tinus_hn on Sunday August 09, 2020 @01:57AM (#24097568)
HomePod is not exactly a cheap device.
Re:Google speakers are listening to more than just voice com... by AsyncAwait on Sunday August 09, 2020 @06:05AM (#24098519)
True, but not expensive either. Especially considering it's on sale all the time.

Even for the cheaper devices, the CPU is probably capable enough, (maybe excluding the cheapest Echo Dot/Nest).

The Echo Show devices even have a screen and are actually designed to play videos from all kind of sources, (decode), as well as for videocalling, (encode) and they're £60 right now on Amazon UK.

Re:Google speakers are listening to more than just voice com... by nitrogen on Saturday August 08, 2020 @02:37PM (#24093991)
If Opus/Speex seems too heavy there are also the codecs used for GSM, VoLTE, etc.
Re:Google speakers are listening to more than just voice com... by Ijumfs on Saturday August 08, 2020 @01:25PM (#24093371)
Yet any of the smart home speakers on the market is more than capable of compressing audio.
Re:Google speakers are listening to more than just voice com... by ineedasername on Saturday August 08, 2020 @03:53PM (#24094644)
Look further up the thread. The bandwidth required to transport such data has not been observed. I don't think anyone would argue that these companies wouldn't have the ability to build a device that streamed everything home. It's that to do so would mean there'd be some observable effect in the device's network usage that has not been observed.
Re:Google speakers are listening to more than just voice com... by asfginino on Saturday August 08, 2020 @11:51AM (#24092550)
>Furthermore, Amazon hasn’t cracked the code on hyper-efficient GB into KB lossless compression only to squirrel it away only for use in voice assistants.

They could do speech recognition on the device and then ship off the plain text. I don't think they do this, but it is most certainly within their technical ability.

As a practical example, I have a copy of a 458,045 word audiobook on my computer and I just downloaded a copy of the e-book. The audiobook is just over 1 GiB, while the plain text of the e-book compressed with bz2 comes in at 800 KiB.

Re:Google speakers are listening to more than just voice com... by zachm0 on Saturday August 08, 2020 @01:15PM (#24093270)
Small knit pick, but speech to text isn’t lossless. How someone says the words has a lot of impact on the meaning of those words. It’s possible Amazon doesn’t care about that lost information but that is a completely different conversation.
Re:Google speakers are listening to more than just voice com... by asfginino on Saturday August 08, 2020 @01:19PM (#24093305)
That's true. Speech to text also isn't entirely accurate, which loses some information.

Even when they actually do ship audio off the device for processing, I'd be surprised if it's done losslessly.

Re:Google speakers are listening to more than just voice com... by scollet on Saturday August 08, 2020 @10:52PM (#24096908)
For anyone curious about this, I highly recommend developing on CMU Sphinx for a weekend project. It will really paint some pictures about machine interpretation based on training data and the actual application code.
Re:Google speakers are listening to more than just voice com... by lotu on Saturday August 08, 2020 @04:27PM (#24094947)
> They could do speech recognition on the device and then ship off the plain text

Not with the tiny cheap CPUs that are one these devices they couldn't. Or at least not very effective speech recognition.

Re:Google speakers are listening to more than just voice com... by MiroF on Sunday August 09, 2020 @12:04PM (#24100513)
I think you overestimate how CPU intensive the inference is.