News for hackers. Stuff that matters.
Re:Descriptive Camera: A camera that prints a description, n... by ghshephard on Wednesday April 25, 2012 @05:31AM (#3888324)
Amazing - the meta concepts behind the "Descriptive Camera" are limited only by the imagination, the resolution of the sensing devices, the ubiquity/bandwidth of the data pipe, and the ability to manage/train the backend human workforce and maintain a consistent level of quality. I'm pretty certain, that within 3-5 years, a billion dollar company will emerge using the basic concepts captured by the "descriptive camera." That is, a remote sensing device feeding data into a human-backed work-management queue, and returning some type of structured higher-level processing of the remote-sensing device's data in close to real-time.

Just off the top of my head:

  o Flora/Fauna identification
  o Scene analysis (Car Crashes/Building Wreckages)
  o Medical analysis
  o Substance analysis
  o Structural integrity review
  o Online Translators.  Today.
I'm pretty certain companies would be more than happy to pay $1000+ for 3-4 hours of a real-time translator than worked through a smartphone for business trips. Ubiquitous high bandwidth wireless (LTE)/High Resolution Mics/Cameras/smartphones are the enabling technologies which trigger this class of application.
Re:Descriptive Camera: A camera that prints a description, n... by mbesto on Wednesday April 25, 2012 @05:38AM (#3888339)
Medical analysis

I don't think I would rely on a description from a Mechanical Turk human for describing what they see in a pictue.

Is that a tibia or a fibula?!?

Re:Descriptive Camera: A camera that prints a description, n... by ghshephard on Wednesday April 25, 2012 @05:41AM (#3888346)
Right - you don't send to Mechanical Turk. You instead send it to a highly trained backend workforce, presumably highly skilled in the vertical that you are doing analysis on. And, it's not just a picture, but video/sound/other sensing. Who knows what the next advances in remote telemetry will be.
Re:Descriptive Camera: A camera that prints a description, n... by jrabone on Wednesday April 25, 2012 @07:17AM (#3888582)
You can always require Mechanical Turks to pass qualification tests before they work on your HITs. There are also pre-existing qualifications like language and location.

Of course, you need to pay well enough to get enough people to bother, but I imagine one could build a reasonably skilled workforce for many areas if your training material is good and you have an objective measure of the correct answer.

This image description application is both perfect and terrible for Mechanical Turk though - it's an ideal task for a human rather than a computer, but it's also impossible to score the result objectively, so you'll have to pay everyone, all the time, or introduce another level of scoring - "Is this an accurate description?" "Does this description read fluently in $LANGUAGE" etc.

Re:Descriptive Camera: A camera that prints a description, n... by anandkulkarni on Wednesday April 25, 2012 @05:51AM (#3888375)
Indeed, we do this kind of work today in MobileWorks, using exactly this fact.

Once your workforce is skilled all kinds of new opportunities of this nature open up.

Re:Descriptive Camera: A camera that prints a description, n... by ghshephard on Wednesday April 25, 2012 @05:59AM (#3888391)
Nice. I guess we don't need to look too far to see that soon-to-be-billion dollar company then. Have you considered doing real-time feedback to a device that has remote telemetry (video/sound/pictures/etc...)?
Re:Descriptive Camera: A camera that prints a description, n... by anandkulkarni on Wednesday April 25, 2012 @06:11AM (#3888415)
We've done some work in this vein already, as a matter of fact: real-time communication between the crowd and cameras / robots. We're currently supporting a few fast camera-driven smartphone applications that developers have built on the platform.

I think what you're after, though, is more comprehensive integration: a remote telemetry system that has crowd intelligence baked into its circuits along several media, rather than one: analyzing simultaneous audio and video. I don't think this would be difficult for a developer to build, and it's a great idea.

Re:Descriptive Camera: A camera that prints a description, n... by mbesto on Wednesday April 25, 2012 @07:01PM (#3891554)
So why is this "technology" ground-breaking then? I thought the point of this is that it that you 1. take picture 2. send over the internets 3. wait 3~6min to get a response on what the picture is about.

Try scaling this out..."highly-trained" means poor scalability and lots of liability.

Re:Descriptive Camera: A camera that prints a description, n... by ghshephard on Thursday April 26, 2012 @03:32AM (#3892877)
The technology isn't ground breaking - it's the combination of five or six technologies that are maturing at the same time that make this sort of application (real time human assessment of remote telemetry) work.
Re:Descriptive Camera: A camera that prints a description, n... by JunkDNA on Wednesday April 25, 2012 @08:18AM (#3888747)
Lots of US hospitals already use offshore radiology services who interpret various medical imaging tests taken in the overnight hours an report back the findings.
Re:Descriptive Camera: A camera that prints a description, n... by mbesto on Wednesday April 25, 2012 @07:02PM (#3891555)
Citation? (note - not trying to be snarky...moreso curious)
Re:Descriptive Camera: A camera that prints a description, n... by Tloewald on Wednesday April 25, 2012 @09:26PM (#3891939)
Re:Descriptive Camera: A camera that prints a description, n... by emmelaich on Wednesday April 25, 2012 @07:18AM (#3888587)
I think the fauna/flora possibility is the strongest. There are lots of amateur gardeners (me:-) who would love to snap something and find out what it is (and hence how best to feed, water and shade it). I've often thought this should be possible with an android/iphone app.
Re:Descriptive Camera: A camera that prints a description, n... by vilya on Wednesday April 25, 2012 @07:39AM (#3888637)
Have you seen Snapseed or Leafsnap?
Re:Descriptive Camera: A camera that prints a description, n... by emmelaich on Monday May 07, 2012 @07:01AM (#3938480)
No I hadn't. Thanks!
Re:Descriptive Camera: A camera that prints a description, n... by hammock on Wednesday April 25, 2012 @01:11PM (#3889984)
This already exists- remember Google Goggles? Except in this implementation it's a little more hipster/artsy since it prints it out for you on receipt paper.

Honestly, as a camera, it is a step backwards. Photographs efficiently capture many times more information than a simple text description.

However, what it is a good demonstration of is the growing cognitive abilities of image-reading machines.

Re:Descriptive Camera: A camera that prints a description, n... by anjc on Wednesday April 25, 2012 @03:22PM (#3890563)
It's not trying to be more hipster by printing descriptions, the pictures are described via Mechanical Turk (from humans), this is why it's interesting.
Re:Descriptive Camera: A camera that prints a description, n... by hammock on Wednesday April 25, 2012 @05:13PM (#3891124)
Ah, well fuck me for not reading the writeup more thoroughly.
Re:Descriptive Camera: A camera that prints a description, n... by anjc on Wednesday April 25, 2012 @06:35PM (#3891466)
You were right that it is artsy though...

(And in your defense, having humans manually describe images in the image recognition domain seems so...unmodern, that your assumption was probably fair)