News for hackers. Stuff that matters.
Re:The Daredevil Camera by Bromskloss on Wednesday June 29, 2016 @06:09PM (#12005178)
Yay, a sound-field camera! I've been wondering if such things are made. Should I take the existence of this project as an indication that they aren't?

The use case I imagine is finding what part of a machine is emitting a noise, much like how you would use a thermal camera for finding what part of it is running hot.

Re:The Daredevil Camera by Artlav on Wednesday June 29, 2016 @06:19PM (#12005228)
Not exactly unheard of, but quite rare. I found a company that made large arrays like that, but they seem to operate in near field, measuring only the sound volume.

Imagine a wall of microphones next to a truck - you can tell which part of the wheel makes the sound. That sort of stuff.

As for an actual "camera" that turns sound into an image - i've never heard of one.

Re:The Daredevil Camera by femto on Wednesday June 29, 2016 @09:14PM (#12005984)
> As for an actual "camera" that turns sound into an image - i've never heard of one.

I have. His name is Daniel Kish [1, 2].

Apparently his visual cortex has learned to process sound rather then light, so he literally sees, based on the sounds he is hearing.

[1] http://www.abc.net.au/catalyst/stories/4441831.htm

[2] https://en.wikipedia.org/wiki/Daniel_Kish

Re:The Daredevil Camera by duaneb on Thursday June 30, 2016 @12:44AM (#12006609)
Unfortunately only he can appreciate his own experience.
Re:The Daredevil Camera by femto on Thursday June 30, 2016 @01:20AM (#12006733)
He gives a pretty decent explanation of what he is seeing in the Catalyst transcript. It's fascinating, as from his description it's a low resolution (due to the longer wavelength) of what you or I would see. Presumably he also sees things such as colours, but based on audio reflectivity rather than optical reflectivity?

Your point about only him appreciating his own experience is interesting, as the same question can be asked of all of us [1]. In audio, maybe apples and oranges are the same colour and strawberries are different? It would be an interesting application of a sonic camera, to render the image so that equivalent audio colours are consistently mapped to the same light colours.

[1] https://www.quora.com/Visual-Perception-Is-everyones-experie...

Re:The Daredevil Camera by nxzero on Wednesday June 29, 2016 @06:23PM (#12005263)
Isn't this exactly what sonar does?

SOund Navigation And Ranging: https://en.m.wikipedia.org/wiki/Sonar

Re:The Daredevil Camera by Artlav on Wednesday June 29, 2016 @06:29PM (#12005299)
Not exactly. A sonar maps a surface using sound, while my camera looks at the sound itself.

Think laser rangefinder on a scanner platform vs a camera.

Re:The Daredevil Camera by benjamincburns on Thursday June 30, 2016 @02:50PM (#12010804)
Have you seen light field photography [1]? It would seem that your array is quite similar in concept. I'd imagine that getting images similar to those produced by various SONAR imaging technologies is a similar sort of deconvolution problem. If you're looking for textbooks or scientific papers to review, I think the field of tomography is also ripe with methods to explore here.

I'd challenge the notion however that this isn't 'just' a passive SONAR device. Keeping the camera analogy, active SONAR use spread spectrum pings, much like the white light of a camera's flash. Your camera lacks a flash function, and its lens is maybe not yet as in focus as it could be.

If you did want to add a flash, you're likely a $0.02 piezo device and maybe $20 in other various parts (and heaps of numerical processing on a PC) away from having the ability to produce a nice 3D reconstruction of the physical scene.

If you get direct data capture going, please do post some raw data online. I'm sure others would have heaps of fun playing around with it.

1: http://graphics.stanford.edu/projects/lightfield/

Re:The Daredevil Camera by Artlav on Thursday June 30, 2016 @03:03PM (#12010882)
Hm, why not - here is the raw data (after PDM decoding) for the 16x16 video from the article: http://orbides.org/etc/snd_16x16_raw.tar.gz (4 Mb)

One file per cell, 16bit integer samples. Stored row by row, 128 slices per frame.

Not sure where to post it, however - here it would be buried.

Re:The Daredevil Camera by Qworg on Wednesday June 29, 2016 @06:44PM (#12005374)
There ARE sonars that deliver an image.

http://blueprintsubsea.com/starfish/images/sonar/452/sf452_s...

That's just one example - look for side scan sonars for the earliest stuff (https://en.wikipedia.org/wiki/Side-scan_sonar) or sonar imaging for the latest stuff (http://www.tritech.co.uk/product/gemini-720i-300m-multibeam-...)

Re:The Daredevil Camera by jdietrich on Wednesday June 29, 2016 @07:27PM (#12005596)
Such systems are ubiquitous on commercial fishing vessels.

https://en.wikipedia.org/wiki/Fishfinder

Re:The Daredevil Camera by yathern on Wednesday June 29, 2016 @06:30PM (#12005308)
No. SONAR sends out an ultrasonic ping and times the response of its echo to get a distance.

This project is similar in that it involves visualization from audio, but apart from that, it's quite difference. This is the ability to see a sound. To derive the positions of arbitrary sounds in a viewing plane, and render it like you would a picture or video.

Re:The Daredevil Camera by willvarfar on Wednesday June 29, 2016 @06:53PM (#12005411)
Yes. Passive sonar only listens to the noise. Passive sonar systems are often arrays too. So the analogy holds quite well from a distance ;)

https://en.wikipedia.org/wiki/Sonar#Passive_sonar

Re:The Daredevil Camera by Qworg on Wednesday June 29, 2016 @06:49PM (#12005389)
He's still driving the scene - illuminating it, if you would.
Re:The Daredevil Camera by colechristensen on Wednesday June 29, 2016 @06:31PM (#12005317)
No.

Most sonar is active (sends out pings) and has only one input (one microphone)

It builds pictures by directing the ping and measuring time until the response.

This is fundamentally different than an array of microphones passively listening to, and creating a fine grained picture of some sound source.

Re:The Daredevil Camera by dragonwriter on Wednesday June 29, 2016 @06:50PM (#12005394)
> Most sonar is active (sends out pings) and has only one input (one microphone)

While I believe the US Navy doesn't prefer the term "Passive Sonar", submarines and some surface ships are equipped with hydrophone arrays (either on the hull, or towed arrays, or both) as well as active sonar; this isn't an uncommon thing. (I was under the impression that the active sonar didn't use a single hydrophone, but instead used the same hydrophone array used for passive detection.)

Re:The Daredevil Camera by votingprawn on Thursday June 30, 2016 @06:16AM (#12007585)
Yes it is. Despite all the other replies asserting SONAR is active, passive SONAR systems are very much a thing.

For my undergraduate project years ago I built a microphone array that could be used to locate noisy objects. I demonstrated it by tracking aircraft taking off at a local airport.

Whilst I didn't make 'acoustic photos' with it, I did plot the flight track of the aircraft in real time, and could have a decent crack at identifying it based on frequency content.

Re:The Daredevil Camera by FreeFull on Wednesday June 29, 2016 @06:33PM (#12005329)
Sonar sends out sound and then listens for the echoes though, rather than just take in sound from other sources.
Re:The Daredevil Camera by votingprawn on Thursday June 30, 2016 @06:24AM (#12007615)
Some types of SONAR send out sound, other types (e.g. [0]) passively listen for sounds and use beamforming to localise the source of the noise.

[0] https://en.wikipedia.org/wiki/Towed_array_sonar

Re:The Daredevil Camera by ProAm on Wednesday June 29, 2016 @06:31PM (#12005316)
Doesn't the army use something like this in the field to determine enemy sniper locations when they are taking pot shots?
Re:The Daredevil Camera by sbierwagen on Wednesday June 29, 2016 @06:37PM (#12005348)
Re:The Daredevil Camera by xlayn on Wednesday June 29, 2016 @06:56PM (#12005422)
Congrats, beautiful history and nice hacking. I hope you get a really big bag of money one of these days so you can keep doing this kind of things!!! kudos!
Re:The Daredevil Camera by skrebbel on Thursday June 30, 2016 @02:01AM (#12006865)
I commented it elsewhere in this thread, but I a company called Sorama has been doing sound camera stuff for quite a while. Afaicr it's based on the phd dissertation of their CEO Rick Scholte so that name might yield some articles you might like.

Cool stuff!

Re:The Daredevil Camera by jo-m on Wednesday June 29, 2016 @06:32PM (#12005318)
There is a Swiss startup called Distran (http://www.distran.ch/) which develops ultrasound cameras. They also have a spherical version which looks really cool and allows 360deg sight, unfortunately I cannot find anything about that one on the website anymore.
Re:The Daredevil Camera by Jommi on Thursday June 30, 2016 @03:50AM (#12007148)
A finnish one too: http://www.nlacoustics.com/ Can someone with more expertise explain the differences between the many companies in this field?
Re:The Daredevil Camera by kabla on Thursday June 30, 2016 @08:13AM (#12007951)
We all have a bit of a different way of approaching the problem and our target market differs somewhat. You can use this technology for a lot of different things, not just the obvious use cases. We're still looking at a lot of applications, so the clearer product differentiation is something that will form as time goes by.

- Kai @ nlacoustics.com

Re:The Daredevil Camera by hjnilsson on Thursday June 30, 2016 @03:29AM (#12007081)
Squarehead makes exactly this product: http://www.sqhead.com

It's used my military & events for drone tracking by sound, and concert venues for seeing where sound leaks out to the surrounding neighborhood. (Among other uses)

Edit: Their example screenshot is even showing an engine block overlaid with acoustic output of the components: http://static1.1.sqspcdn.com/static/f/1431009/18268254/13373...

Re:The Daredevil Camera by ChuckMcM on Wednesday June 29, 2016 @08:04PM (#12005759)
No, not common, but as the OP noted the evolution of MEMs based microphones might make them a lot more common. As the author notes, they are more like holographic cameras than what many people think of as "regular" cameras. By converting the imaging into the FFT domain the resolution gets better "everywhere" the more sensors you add. (If you have ever cut up a hologram into smaller and smaller pieces you can see this in action, as the full image is still there, just lower resolution). It would also be interesting to illuminate a non-active source with sound beam. By using two, slightly out of phase, ultrasonic sources he might be able to reveal depth detail of the surface being imaged.
Re:The Daredevil Camera by gene-h on Wednesday June 29, 2016 @06:52PM (#12005404)
Well as it happens there are special sonar cameras out there capable of providing real-time video images[0][1].

The use case here is being able for a diver or ROV to see in murky water

[0]http://www.soundmetrics.com/image-gallery [1]http://www.apl.washington.edu/programs/z_DIDSON/Pages/LIMIS....

Re:The Daredevil Camera by space_fountain on Wednesday June 29, 2016 @06:56PM (#12005421)
Not quite the same thing though. These systems are active. They have sound being produces most likely at a very specific frequency and then listened for so that depth information can be gathered. This instead images the sound that's already out there in the light. It's the difference between lidar and a camera
Re:The Daredevil Camera by wbeaty on Wednesday June 29, 2016 @11:03PM (#12006312)
Nope, theirs is the sound-camera, detector array and sound-lens, but with an acoustic floodlight. I think they do use ranging though, so the 2D image is "sound camera" in one raster dimension, and "sonar range" in the other.
Re:The Daredevil Camera by moheeb on Wednesday June 29, 2016 @07:18PM (#12005557)
Sounds to me more like the difference between using the flash or not.
Re:The Daredevil Camera by eric_h on Wednesday June 29, 2016 @09:48PM (#12006085)
Sort of, except the "camera" can't make any use of "light" generated by anything other than the flash.
Re:The Daredevil Camera by aeling on Wednesday June 29, 2016 @06:21PM (#12005240)
http://visisonics.com/apps/#nsi

I'm unaffiliated, but saw one of their demos.

Re:The Daredevil Camera by visakanv on Wednesday June 29, 2016 @06:11PM (#12005191)
That's a very sensible use case. I was thinking more like, super-trippy live music visuals.
Re:The Daredevil Camera by joshu on Wednesday June 29, 2016 @06:17PM (#12005218)
Re:The Daredevil Camera by Bromskloss on Wednesday June 29, 2016 @06:51PM (#12005399)
Yours is sensible too.
Re:The Daredevil Camera by wtvanhest on Wednesday June 29, 2016 @08:56PM (#12005935)
Visisonics had a device that did something like that.
Re:The Daredevil Camera by wbeaty on Wednesday June 29, 2016 @11:01PM (#12006302)
Search: acoustic camera. They sell phase-array microphones for mapping noise sources. Rather than a plane array, theirs is a sphere.