News for hackers. Stuff that matters.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by wallacoloo on Sunday January 17, 2016 @10:09PM (#10922344)
This is a fantastic idea, but do web pages really not require special permissions to access gyroscope data?

On Android (like, 4.2 or something) with Firefox, the page and the CSV just displays `null` for alpha, beta and gamma. And the calculated rate is 9.1 samples per second, which seems way too low to extract any speech details even if the data were valid.

This is distinct from the "No device motion data" message presented on my desktop though. So it seems to me that the page sees that a gyroscope is present, and requests data from it, but Firefox is just feeding it null values?

I haven't tried the apk yet.

Re:Recognizing Speech from Smartphone Gyroscopes (2014) by tagawa on Monday January 18, 2016 @12:40AM (#10922721)
Re. web pages, the feature is called DeviceOrientation Event and no, the spec doesn't require user permission: https://www.w3.org/TR/orientation-event/
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by dennisnedry on Monday January 18, 2016 @02:59AM (#10923162)
Tried it on Mobile Safari (iOS 9.2) - works. Pretty crazy, there was no need to give permissions.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by johansch on Sunday January 17, 2016 @11:51PM (#10922576)
Chrome on Android shows the proper data - with no special permissions or warnings. It updates at ~57 samples/s.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by boxstream on Monday January 18, 2016 @12:05AM (#10922612)
If you check the paper the authors indeed mention some rate limitations using Chrome. However Firefox provides samples at 200 Hz. Also, every application can access those measurements without any permissions.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by blincoln on Monday January 18, 2016 @10:07AM (#10924767)
As the authors note in the full paper, even a sample rate of 200 Hz only results in capturing audio information for frequencies up to 100 Hz.

If one applies a 100 Hz filter to some samples of human speech (even low-pitched male voices, as the authors of the paper suggest), the result is (unsurprisingly) the sort of "womp womp" that one might expect to hear from a car with giant subwoofers, not anything containing recognizable words.

The authors of the paper admit that they were unable to recover the content of speech, but focused on identifying the speaker. That's a long way from capturing credit card numbers (which is what their promo video implies).

Basically, I'll believe it when I see it. The approach is really interesting, though, and I think could be useful for other things.

Re:Recognizing Speech from Smartphone Gyroscopes (2014) by userbinator on Monday January 18, 2016 @01:07AM (#10922789)
Would accelerometers also be usable in a similar way? Presumably magnetometers wouldn't be quite as sensitive to such vibrations.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by threecoins on Monday January 18, 2016 @03:00AM (#10923167)
Seems like if auto rotate is off, this does not work.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by bahmboo on Monday January 18, 2016 @03:31AM (#10923261)
2014
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by leni536 on Monday January 18, 2016 @03:07AM (#10923186)
Solution: low pass filter gyroscope sensor data before the application can access it. Is there a legitimate reason for an application to need gyroscope data in the range of ~200Hz?
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by wallacoloo on Monday January 18, 2016 @03:23AM (#10923237)
I think this is a legitimate usage for some games, for example, racing games in which you steer via tilt. The bigger issue in this case is not the frequencies visible to the application (the relevant hand motion is much below 200 Hz), but rather the latency of these movements. If possible, a game should be able to respond to a tilt action within the duration of a single frame.

But it's impossible to filter a signal in the time domain without introducing a phase shift (i.e. a delay). As a result, you cannot remove that extra frequency information before sending the data to an application without making sacrifices on latency.

Re:Recognizing Speech from Smartphone Gyroscopes (2014) by leni536 on Monday January 18, 2016 @06:27AM (#10923770)
Alternative solution: make the unfiltered gyro data available through an explicit permission.
Re:Recognizing Speech from Smartphone Gyroscopes (2014) by wallacoloo on Monday January 18, 2016 @05:35PM (#10927515)
Perhaps it's possible to use some sort of active cancellation - like what noise-cancelling headphones do - only in this case you would be trying to minimize the correlation between gyroscopic data & microphone data.