News for hackers. Stuff that matters.
Re:This AI Boom Will Also Bust by pesenti on Saturday December 03, 2016 @11:54AM (#13096369)
When I was at Watson this is the first thing I told every customer: before you start with AI are you already doing the more mundane data science on your structured data? If not, you shouldn't go right away for the shiny object.

This said I still believe the article is mistaken in its evaluation of potential impact (and its fuzzy metaphore of pipes). Unstructured or semi-structured or dirty data is much more prevalent than cleaned structured data on which you can do simple regression to get insight.

Ultimately the class of problems solved by more advanced AI will be incommensurably bigger than the class of problems solved by simple machine learning. I could make a big laundry list but just start thinking of anything that involves images, sound, or text (ie most form of human communication).

Re:This AI Boom Will Also Bust by dheera on Saturday December 03, 2016 @12:35PM (#13096555)
And before you do mundane data science on your structured data, you should figure out if there is a better way to get cleaner raw data, more data, as well as more accurate data.

For example, I predict stereo vision algorithms will die out soon, including deep-learning-assisted stereo vision. It's useful for now but not something to build a business around. Better time-of-flight depth cameras will be here soon enough. It's just basic physics. I worked on one for my PhD research. You can get pretty clean depth data with some basic statistics and no AI algorithm wizardry. We're just waiting for someone to take it to a fab, build driver electronics, and commercialize it.

Re:This AI Boom Will Also Bust by dTal on Saturday December 03, 2016 @01:53PM (#13096915)
Stereo vision is obviously highly effective in biology as it has independently evolved a great many times. Time-of-flight may be poised for a renaissance, but it scales badly and is active, not passive. Stereo vision, and its big brother light fields, are far more general and are certainly not going to "die out".
Re:This AI Boom Will Also Bust by sangnoir on Saturday December 03, 2016 @03:52PM (#13097442)
> Stereo vision is obviously highly effective in biology as it has independently evolved a great many times

This argument sounds like a second cousin of the "chemicals are bad, but if it is natural it is good" argument. Just because it evolved in nature doesn't mean it's optimal, or it's the best system under massively different constraints. And who knows what evolution would have thrown up after a few more billion years.

Re:This AI Boom Will Also Bust by aangjie on Sunday December 04, 2016 @09:07AM (#13100012)
I think the point he was making is that it is effective in different environmental challenges and constraints. Not that it's optimal. So it might still be useful for building into a robot that's supposed to explore a environment(think space and planets for example). It may get relegated to academia, if we find other optimal solutions for our robots doing our boring chores though.
Re:This AI Boom Will Also Bust by eli_gottlieb on Saturday December 03, 2016 @05:41PM (#13097850)
Human vision is active rather than passive as well. We really wouldn't be able to get around the world if we relied on passive inference from sensory stimuli to model our environment.
Re:This AI Boom Will Also Bust by revelation on Saturday December 03, 2016 @02:04PM (#13096969)
Yet humans produce terrible depth data.
Re:This AI Boom Will Also Bust by kd0amg on Saturday December 03, 2016 @03:05PM (#13097267)
Terrible for what purpose? Humans seem pretty good at throwing things to each other and catching them. I'm very bad at coming up with a good numeric estimate of linear size. As a fencer, I could never tell you how many inches between me and my opponent, how long his or my arms are, how tall he is, etc. I could definitely tell you which parts of our bodies are within reach of each other's arm extension, fleche, lunge, etc.
Re:This AI Boom Will Also Bust by michaelt on Saturday December 03, 2016 @06:35PM (#13098027)
Terrible for the purpose of proving a general-purpose stereo machine vision system is practical.

The distance at which a stereo vision system can capture precise depths depends on the distance between eyes, and the eyes' angular resolution. Human depth perception works well for things within about 10m, but when you get out to 20-40m humans get a lot less info from stereo vision.

When you get to that distance, humans seem to have a whole load of different tricks - shadows, rate of size change, recognising things of known size, perspective and so on. You can see a car and know how far it is even without stereo vision, because you know how big cars are, and how big lanes and road markings are. You can even see two red lights in the distance at night and work out whether they're the two corners of a car, or two motorbikes side-by-side and closer to you.

On the other hand, your basic general-purpose stereo machine vision system doesn't try to understand what it's looking at - you just identify 'landmarks' that can be matched in both images (high contrast features, corners etc) and measure the difference in angle from the two cameras. This is relatively simple and easy to understand!

For tasks that humans can do that involve depth perception of things more than ~40m away - flying a plane, for example, where most things are more than 40m away if you're doing it right! - nice simple stereo vision can't get the job done, because humans are actually using their other tricks.

Of course, despite this limitation stereo vision comes up a lot in nature - it's still a beneficial adaption, because most things in nature that will kill you do so from less than 10m away :)

Re:This AI Boom Will Also Bust by matt_kantor on Saturday December 03, 2016 @10:33PM (#13098664)
> Of course, despite this limitation stereo vision comes up a lot in nature - it's still a beneficial adaption, because most things in nature that will kill you do so from less than 10m away :)

It's actually pretty rare for non-predatory animals to have good stereo vision. Most of them are optimized for a wide field of view instead, evolving eyes placed on either side of their head. Think rabbits, parrots, bison, trout, iguanas, etc.

https://en.wikipedia.org/wiki/Binocular_vision

https://www.quora.com/Why-have-most-animals-evolved-to-see-o...

Re:This AI Boom Will Also Bust by taneq on Sunday December 04, 2016 @09:05AM (#13100010)
It depends what you mean by "practical", though. If you mean "practical for use as a dense 3D reconstruction technique" then sure, it's pretty bad. If you mean "usable under an incredible range of lighting conditions and situations" then I'd say it's practical.

Edit: IMO binocular vision is probably more to do with redundancy than depth perception. If you damage or lose an eye, you can still operate at near full capacity. Losing vision 'in the wild' is a death sentence.

Re:This AI Boom Will Also Bust by jonathankoren on Saturday December 03, 2016 @03:00PM (#13097249)
Humans produce good enough depth data.
Re:This AI Boom Will Also Bust by kgwgk on Saturday December 03, 2016 @03:03PM (#13097261)
What does it mean? I'd say the ability to perceive depth is pretty useful.
Re:This AI Boom Will Also Bust by ianai on Sunday December 04, 2016 @02:37AM (#13099182)
Actually brains eventually learn how to discern distance with one eye too, iirc.
Re:This AI Boom Will Also Bust by pesenti on Saturday December 03, 2016 @12:49PM (#13096624)
Right but in this case there is a trade-off: if you don't have the better data now how long before you will? Should you start now (and gain a time advantage at a cost) with what you have or wait for the better data (read sensor/process/technology/people etc).

My experience is that waiting for cleaner data is often like waiting for Godot and will often be a project killer (sometimes justifiably). This is a key issue at the moment in advanced ML: clean large training sets ideal for supervised training are elusive and the companies making real-world advances are pretty much all using available data (and semi-supervised techniques) rather than expensive made up training sets.

Re:This AI Boom Will Also Bust by eli_gottlieb on Saturday December 03, 2016 @03:14PM (#13097300)
>Better time-of-flight depth cameras will be here soon enough. It's just basic physics. I worked on one for my PhD research. You can get pretty clean depth data with some basic statistics and no AI algorithm wizardry. We're just waiting for someone to take it to a fab, build driver electronics, and commercialize it.

You should talk to us at Leaflabs. Commercializing research-level tech in embedded electronics is what we do.

Re:This AI Boom Will Also Bust by mathperson on Saturday December 03, 2016 @04:43PM (#13097659)
are you guys looking to hire anyone with compressed sensing/neuro-imaging experience? possibly someone with the username /mathperson lol
Re:This AI Boom Will Also Bust by eli_gottlieb on Sunday December 04, 2016 @03:29PM (#13101640)
Neuro-imaging? Very probably. Send a resume and cover letter.
Re:This AI Boom Will Also Bust by enriquto on Sunday December 04, 2016 @09:21AM (#13100062)
> For example, I predict stereo vision algorithms will die out soon, including deep-learning-assisted stereo vision

Maybe for regular "cameras", but parallax still gives the most accurate results for 3D reconstruction from satellite images, where it is a very lively area of research. The resolution, and surface coverage, of radar satellites is far worse than what you can obtain by stereo matching optical images taken by the powerful telescopes on satellites. I guess in other fields like microscopy it makes a lot of sense also. Not all imaging happens indoor on commodity cameras!

Re:This AI Boom Will Also Bust by MrQuincle on Saturday December 03, 2016 @03:15PM (#13097305)
However as ma2rten eloquently describes, for the purpose of AI research it might be beneficial to bite through the harder AI required when only having access to stereo vision.

A lot of problems are not tackled on a fundamental level. Occlusion, context, proprioception, prediction, timing, attention, saliency, etc.

A simple rat has more intelligence than whatever is behind a dashcam, security cam or webcam.

Re:This AI Boom Will Also Bust by AndrewKemendo on Sunday December 04, 2016 @12:10AM (#13098869)
You're ignoring form factor for optimized technology.

Yes, a quality TOF system would be great. However good luck convincing consumers to adopt hardware with lidar on it. The Tango is having enough trouble on it's own and it does pretty well for consumer systems with IR.

Besides that you can't do FTDT with laser systems AFAIK. You need something to capture unseen places, such as ultrasonics/HF - which I guess you could argue fall into TOF but I haven't seen that work done.

In the end my money (literally!) is on the opposite if your approach, namely building better RGB systems because there are already a trillion cameras deployed that we can extract from.

Re:This AI Boom Will Also Bust by kken on Saturday December 03, 2016 @01:05PM (#13096691)
Already happening. The activity in the TOF-field is crazy.

First project Tango smartphone will be out soon.

Re:This AI Boom Will Also Bust by sherbondy on Saturday December 03, 2016 @02:26PM (#13097088)
First consumer Tango phone is already out!

http://shop.lenovo.com/us/en/smartphones/phab-series/phab2-p...

I think it first went on sale Nov. 1 but just started shipping initial batches recently.

Re:This AI Boom Will Also Bust by taeric on Saturday December 03, 2016 @12:38PM (#13096572)
I think the hidden strife in your triplet is a land mine. That is, getting more data is at odds with cleaner data for most folks. Adding accuracy? I hope you remember the difference between precision and accuracy. :)

(None of which takes from your point.)

Re:This AI Boom Will Also Bust by cma on Saturday December 03, 2016 @04:02PM (#13097477)
Any links to your papers? How much better have things gotten over e.g. Kinect v2, which was pretty bulky and power hungry, and had active cooling? I'd imagine it has gotten a lot better.
Re:This AI Boom Will Also Bust by agumonkey on Saturday December 03, 2016 @12:56PM (#13096655)
ToF depth being single POV and depth infered from successive frames ?
Re:This AI Boom Will Also Bust by blackguardx on Saturday December 03, 2016 @01:53PM (#13096917)
A light source built into the camera is modulated in time. The camera uses this to infer depth. When the modulation is synced up right, the camera can see the light wave "travel" as it illuminates close objects first and then farther ones over successive frames. The camera isn't actually fast enough to capture the light wave traveling, but the timing between the shutter and the light source is shifted by nanoseconds each frame to accomplish this.

They can have problems operating outside because it is hard to make a lightsource brighter than the sun.

Re:This AI Boom Will Also Bust by Animats on Saturday December 03, 2016 @02:22PM (#13097066)
That's an older form of ranging. It's easier to do than pulse ranging, but you have to outshine ambient light at the color being used full time. The Swiss Ranger [1] is a good example of such a system. It's indoor only and short range. With a pulse system, you only have to outshine ambient light for a nanosecond, which is quite possible in sunlight.

I've been expecting good, cheap non-scanning laser distance imagers for a decade. In 2003, I went down to Advanced Scientific Concepts in Santa Barbara and saw the first prototype, as a collection of parts on an optical bench. Today ASC makes good units [2], but they cost about $100K. DoD and Space-X buy them. There's one on the Dragon spacecraft, for docking. That technology isn't inherently expensive, but requires custom semiconductors produced with non-standard processes such as InGaAs. Those cost too much in small volumes. There's been progress in coming up with designs that can be made in standard CMOS fabs.[3] When that hits production, laser rangefinders will cost like CMOS cameras.

[1] http://www.adept.net.au/cameras/Mesa/SR4000.shtml [2] http://www.advancedscientificconcepts.com/products/overview.... [3] https://books.google.com/books?id=Op6NCwAAQBAJ&lpg=PA64

Re:This AI Boom Will Also Bust by sherbondy on Saturday December 03, 2016 @02:17PM (#13097038)
Hey, 3D vision system amateur here, but very interested to learn more!

Can anybody point me to some literature or reference materials about attempts to combine the inputs from multiple techniques simultaneously?

E.g. a device with stereo conventional cameras and infrared cameras & emitters which compares the resulting model from each input source/technique and actively re-adjusts final depth estimate?

Is "sensor fusion" the right jargon to use in this context?

Or, even crazier, a control system which actively jitters the camera's pose to gain more information for points in the depth map with lower confidence scores / conflicting estimates?

But maybe such a setup is overly complex and yields minimal gains in mixed indoor & outdoor scenarios?

Re:This AI Boom Will Also Bust by guycook on Saturday December 03, 2016 @05:27PM (#13097802)
We have a setup that combines ToF, structured light and multiple colour cameras to reconstruct hands from the elbow down. Short version: it's a massive pain in the ass. In fact the setup really only works because we have a preconceived motion model (particular hand gestures) and have carefully arranged the scene to avoid interference. I'm unaware of a general solution where you can just throw more cameras in and get better scene data.

One neat thing though you might want to look at: if all you have is structured light (ie Kinect v1) you can simply attach a vibrating motor to each emitter/receiver to avoid a lot of interference per [0]

[0] https://wwwx.cs.unc.edu/~maimone/media/kinect_VR_2012.pdf

Re:This AI Boom Will Also Bust by sirclueless on Saturday December 03, 2016 @01:46PM (#13096884)
No, that would also qualify as "AI algorithm wizardry" as dheera puts it. Instead it's just a hardware sensor that measures the time at which light arrives at each pixel. Knowing the speed of light you can calculate the depth of each pixel.
Re:This AI Boom Will Also Bust by agumonkey on Saturday December 03, 2016 @01:55PM (#13096929)
Oh I see, a physical "Z-Buffer".
Re:This AI Boom Will Also Bust by tptacek on Saturday December 03, 2016 @01:47PM (#13096887)
So the basic criticism here is than Hanson, in suggesting firms clean up their data and then apply simple analytics to it, is defining away the problem that ML solves?
Re:This AI Boom Will Also Bust by jeremyjh on Saturday December 03, 2016 @02:38PM (#13097160)
Hanson is economist, not a computer scientist. He may not be right about exactly why the hype is unfounded. But he is not wrong about the fact that it is unfounded. There is no "awe-inspiring" rate of success with these projects, no massive revenue streams that are boiling up all over the landscape, which is absolutely what would have to be happening already to possibly justify predictions of "47% of US jobs in 20 years".

The giant piles of dirty data are that way because for thirty years no one has considered them worth cleaning up. How will they create such astounding amounts of unexpected value?

Re:This AI Boom Will Also Bust by pesenti on Saturday December 03, 2016 @02:56PM (#13097241)
> The giant piles of dirty data are that way because for thirty years no one has considered them worth cleaning up. How will they create such astounding amounts of unexpected value?

It was left that way because we didn't have the tools to process it. Imagine the amount of unprocessed video data that we can now annotate pretty accurately. What's the value of that data now?