News for hackers. Stuff that matters.
Re:Tesla crash victim had complained about auto-pilot in sam... by shawn on Friday March 30, 2018 @06:42PM (#16720431)
Heisenbugs in AI are also interesting. As computers approach sentience, it will become progressively harder to explain their behavior.

Why did you eat a bagel instead of eggs this morning? Usually there isn't a scientific answer.

In the present, AI models are already so complicated that it seems hard to get reproducible diagnostic results, short of just saving every frame of data that the car's sensors pick up. And for video that seems rather prohibitive. Imagine collecting all sensor data for each of those 200 trips per day along the entire stretch of road.

Re:Tesla crash victim had complained about auto-pilot in sam... by azinman2 on Friday March 30, 2018 @08:35PM (#16720945)
Id be willing to take a 1k bet that computers won’t approach sentience in our lifetime. Don’t believe the AI hype train, there hasn’t been a real breakthrough. Just more accurate versions of the same (dumb) classifiers.
Re:Tesla crash victim had complained about auto-pilot in sam... by baddox on Friday March 30, 2018 @08:40PM (#16720963)
Why do you think that humans are not just even more accurate versions of the same types of classifiers?
Re:Tesla crash victim had complained about auto-pilot in sam... by azinman2 on Friday March 30, 2018 @11:39PM (#16721576)
Because we integrate, learn, plan, abstract, create, have way more senses, complex memory, societal and cultural embeddings, and a whole host of things that make us human. A text box on hacker news is not the place for such a reply. Go take some cognitive science, neuroscience, anthropology, sociology, psychology, and philosophy classes and you’ll see why. “AI” as we know it is a joke, particularly as media has hyped it.

The original guys (McCarthy, minskey, etc) at least understand the gigantic complexity of the undertaking in so far as we understand how the mind works at all, and they never reduced things purely to classifiers. That’s like 0.1% of the job. The real researchers take philosophy of mind seriously — technologists want a quick and cheap solution that cannot exist.

Re:Tesla crash victim had complained about auto-pilot in sam... by jobigoud on Saturday March 31, 2018 @05:41AM (#16722574)
This is way more than what's required for sentience though. Sentience is having a notion of self, many animals are sentient.

Maybe you meant sapience or intelligence, but I wonder if people think computers won't be sentient (as in self aware) in our lifetime, even if they are still not able to match human cognition.

Re:Tesla crash victim had complained about auto-pilot in sam... by smallnamespace on Saturday March 31, 2018 @02:11AM (#16722003)
> Because we integrate, learn, plan, abstract, create, have way more senses, complex memory, societal and cultural embeddings, and a whole host of things that make us human.

And yet all this complexity and purpose may potentially be simply the product of putting a large collection of matter in a heat bath for a few billion years.

Who says that this process can't be repeated via brute force simulation? That the emergence of complexity and life under thermal disequilibrium + sufficient number of degrees of freedom is actually a basic fact of the universe?

I don't see any rule saying why, with sufficient brute force computational power, we won't be able to set up better and better simulations that will allow for the arise of true artificial intelligences.

Re:Tesla crash victim had complained about auto-pilot in sam... by azinman2 on Sunday April 01, 2018 @10:54PM (#16731952)
I’m sure some smarter people than me has tried to take stabs at estimating what’s required to do this, so I can’t positively say this will or will not ever happen (especially with quantum computing). But do consider:

We think the brain has 100 billion neurons. Making those work is a very complex network, lots of chemical gradients, bio-electrical systems, cellular-level systems, and probably a host of other things we don’t know about. So it wouldn’t surprise me if for single neuron you’d need to model another billion things at minimum.

Now factor in all of the other input senses, and those 100B neurons have increased dramatically for I/O. Plus a multiplier to model everything going on inside a neuron. Then there’s also modeling the communication layers between, effects of myelin sheaths and all that.

So we’ve established that just to run a single “step in time” (whatever that means, as that’s a computing concept), we’re into probably billions of trillions of calculations.

Now what those model have to make sense and do something coherent. Every future step. So now you need some kind of meta model that is able to push this forward and continue in the right trajectory. Now complexity is dramatically even higher.

Now that we’ve somehow figured out how to model everything required for intelligence, we need to search that space through brute force, as you put it.

To me it seems like the time required will be astronomical — Sun might have blown up by then.

So why go down this route? Nature solved this in parallel relatively cheaply through billions of iterations and billions of permutations over tens of thousands of years.

Seems easier to simplify the problem down to more basic stuff that works well enough and iterate / combine systems. Either that or find a way to grow a “brain in a test tube” that you can hookup to a computer. There’s also always humans available at mass scale for pretty cheap across the globe — sophisticated intelligence built in.

Re:Tesla crash victim had complained about auto-pilot in sam... by richardknop on Saturday March 31, 2018 @09:12AM (#16723154)
> And yet all this complexity and purpose may potentially be simply the product of putting a large collection of matter in a heat bath for a few billion years.

It doesn't have to be. There are alternatives to that.

Re:Tesla crash victim had complained about auto-pilot in sam... by aorloff on Saturday March 31, 2018 @12:37AM (#16721749)
Because humans have agency, a quality we seriously dislike in things we create (control). If a computer woke one morning and said, I like being plugged in more consistently I'm moving to your neighbor's house we would not like that computer much, even though that might be more "intelligent" behavior from its perspective. So we basically don't allow things we engineer to have "real" intelligence because that would include qualities we don't like in our creations.
Re:Tesla crash victim had complained about auto-pilot in sam... by neffy on Friday March 30, 2018 @09:03PM (#16721040)
because we invented cars. And a few other things.
Re:Tesla crash victim had complained about auto-pilot in sam... by dorgo on Saturday March 31, 2018 @03:57AM (#16722292)
Among these other things which we invented are algorithms which invented other algorithms to solve real world problems. There is nothing unuique or irreplicable about humans (save of culture, emotions, etc. which nobody wants to replicate).
Re:Tesla crash victim had complained about auto-pilot in sam... by neffy on Saturday March 31, 2018 @12:41PM (#16723981)
While it may come to pass that we do those things, so far all we've managed to replicate is the first 6 or so levels of the visual processing field.

Methinks there is far further to go than we realise - especially with the current air of hubris around the entire endeavour.

Re:Tesla crash victim had complained about auto-pilot in sam... by headgsaket on Saturday March 31, 2018 @10:25AM (#16723407)
I’d be willing to make the same bet, the problem would be one of definition.
Re:Tesla crash victim had complained about auto-pilot in sam... by buvanshak on Friday March 30, 2018 @06:58PM (#16720507)
https://en.wikipedia.org/wiki/Catastrophic_interference

>Catastrophic interference, also known as catastrophic forgetting, is the tendency of an artificial neural network to completely and abruptly forget previously learned information upon learning new information.

Re:Tesla crash victim had complained about auto-pilot in sam... by tensor on Friday March 30, 2018 @10:05PM (#16721251)
These self driving systems are not likely learning in realtime. When the algorithms are updated, best practice is to validate their performance on a large regression set. So something like this should be caught during validation, assuming your test data is good.
Re:Tesla crash victim had complained about auto-pilot in sam... by throwaway2048 on Friday March 30, 2018 @11:48PM (#16721614)
No set of test data can exist that covers every real world situation.
Re:Tesla crash victim had complained about auto-pilot in sam... by jobigoud on Saturday March 31, 2018 @05:33AM (#16722547)
We also see this in unexplainable flash crashes from high speed trading softwares gone bersek. The speed at which they handle data is so immense than going through the logs of a few seconds around the issue could take several years of human time.
Re:Tesla crash victim had complained about auto-pilot in sam... by smartician on Friday March 30, 2018 @07:31PM (#16720657)
Aren't many AI methods also inherently probabilistic? That would make it by definition impossible to definitively explain any particular behavior.
Re:Tesla crash victim had complained about auto-pilot in sam... by letlambda on Friday March 30, 2018 @08:47PM (#16720982)
If you have a probability vector, you would typically take the max, not model the action on the probability distribution.

e.g. If an image (from the forward camera) returns the probability vector: {"stop_sign": .9, "green_light": .1} You stop the car 10/10 times.

Re:Tesla crash victim had complained about auto-pilot in sam... by baddox on Friday March 30, 2018 @08:44PM (#16720973)
What do you mean by probabilistic? If you mean that the models takes input and outputs one or more labeled probabilities (e.g. “90% confidence the input photo is a dog, 10% confidence the input photo is a cat), then yes, I believe that many AI systems work this way. If you mean random, in the sense that the system may return different results given the exact same inputs, then in not sure if there are AI systems that work that way.
Re:Tesla crash victim had complained about auto-pilot in sam... by joshuamorton on Friday March 30, 2018 @09:00PM (#16721030)
There are. Monte Carlo methods is the keyword you're looking for. AlphaGo (Monte Carlo Tree Search) is an example of one such AI.

Obviously you can set the RNG seed to be the same every time too, but even that only works if your system is wholly synchronous, which a car probably isn't.

Note that I doubt Monte Carlo methods are common in the autonomous vehicle space.

Re:Tesla crash victim had complained about auto-pilot in sam... by TaylorAlexander on Friday March 30, 2018 @10:36PM (#16721354)
Well I don’t work in autonomous cars but I did work on several autonomous robots, and “ Adaptive Monte Carlo Localization” is a common way to keep a ROS + LIDAR based robot localized.

I wouldn’t be surprised if Monte Carlo techniques are useful for all manner of things related to ingesting sensor data on autonomous vehicles.

Re:Tesla crash victim had complained about auto-pilot in sam... by chaboud on Saturday March 31, 2018 @01:30AM (#16721908)
I'd expect Monte Carlo methods to be used in a number of cases that have deterministic time envelopes for evaluation. Randomized selection and evaluation can be incredibly effective. They also resist degenerate structured input vulnerabilities.

I'm not in the automotive space, but I'd be surprised if there were a viable self-driving car team not using Monte Carlo methods somewhere in the vehicle stack.

Re:Tesla crash victim had complained about auto-pilot in sam... by joshuamorton on Saturday March 31, 2018 @02:00AM (#16721980)
Yeah, this was unfortunately worded. There are subproblems for which MC/randomized methods fit well, but in general those circumstances are well understood.
Re:Tesla crash victim had complained about auto-pilot in sam... by tytytytytytytyt on Friday March 30, 2018 @07:41PM (#16720704)
I don't think that means it's impossible. You can still log all inputs and sources of entropy.