Re:Optical microphone can separate multiple instruments from...
by macgyverismo on Monday June 27, 2022 @07:23AM
(#31893025)
I love the creative use of the rolling shutter, instead of seeing it as a downside, they turned the line-by-line nature of the sensor into sample rate multiplier.
[ Parent
| on HN ]
Re:Optical microphone can separate multiple instruments from...
by dougabug on Tuesday June 28, 2022 @10:55PM
(#31915941)
The use of rolling shutter to increase effective sampling rate was present in the original SIGGRAPH 2014 Davis et al paper from Bill Freeman’s group at MIT, “The Visual Microphone: Passive Recovery of Sound from Video” (https://dspace.mit.edu/handle/1721.1/100023).
The authors of the current paper cite this and other prior work. The key innovation is the use of both a rolling shutter and a global shutter reference.