Re:Show HN: Lipreading with Deep Learning
by kakarot on Saturday October 20, 2018 @07:52PM
(#18266090)
Here you go:
https://news.mit.edu/2014/algorithm-recovers-speech-from-vib...
Frequency attenuation + sub-pixel color profiling means you don't even need an expensive camera in a lot of cases.
Get a plastic cup of water or similar object, put it on someone's desk, record video from far away, combine with something like this [0] and you've got a very interesting avenue for corporate espionage. If you could reconstruct typed passwords from the object, it's a really powerful technique.
[0] https://people.eecs.berkeley.edu/~tygar/papers/Keyboard_Acou...
Re:Show HN: Lipreading with Deep Learning
by asdfasgasdgasdg on Saturday October 20, 2018 @05:01PM
(#18265446)
For windows, they already have this, IIUC. You bound a laser beam of the window and measure the vibrations. Random guys can just do this in their garage.
Re:Show HN: Lipreading with Deep Learning
by conistonwater on Saturday October 20, 2018 @05:39PM
(#18265644)
The Applied Science guy is most definitely not a random guy in a garage, though, he's incredibly skilled and talented. The rest of his youtube channel is pretty amazing also.
Re:Show HN: Lipreading with Deep Learning
by Shish2k on Saturday October 20, 2018 @06:48PM
(#18265901)
I am a random guy in a garage, and I made a functional laser microphone using random bits of electronics I had in my spare-bits box ($1 laser pointer, old pair of earphones, snip off the earphone and wire in a light dependent resistor) -- admittedly the quality was awful (you could only just make out voices if people in the room talked abnormally loud), but it was great for a fun weekend science project :D
Re:Show HN: Lipreading with Deep Learning
by samstave on Saturday October 20, 2018 @08:15PM
(#18266171)
A write-up or vid of the components and build would be interesting..
Re:Show HN: Lipreading with Deep Learning
by gugagore on Saturday October 20, 2018 @07:38PM
(#18266040)
I would imagine an LDR would be too slow to have a good response to audio.
Re:Show HN: Lipreading with Deep Learning
by ehsankia on Saturday October 20, 2018 @06:45PM
(#18265891)
You can do it with video too, even:
https://www.youtube.com/watch?v=FKXOucXB4a8
Also, this is only tangentially related, but you can also see through walls using WiFi: https://www.youtube.com/watch?v=kBFMsY5ZP0o
I wonder if this technique has made its way from MIT to the clandestine services yet... you sort of have to assume it has.
I can't imagine that there arent already some Palantir-like efforts to accomplish this.
Imagine a REALLY good zoom lens on a very small drone that can not be seen/heard by a target and that drone is doing something like this to gain info.
Imagine the same zooming through windows as well.
This will be the next big ML-military step towards Total Information Awareness taken, if its not already available in the wild.