News for hackers. Stuff that matters.
Re:Why AI is a dangerous dream - interview with Noel Sharkey by anigbrowl on Friday September 04, 2009 @06:21PM (#805865)
Oh God.

We can automate a process, and with technology we can automate increasingly complex processes. But intelligence is a fundamentally different problem from the things you describe. I am a believer in the possibility of strong AI. I can envision and would like to live a world of sentient machines. But your way of thinking, as expressed here, will not get us there.

Let's take the example of robot soccer players. I agree with you, it's basically just an engineering problem. We have robots that walk around, we have computers that can solve ballistic problems in real time, we have networking and so on. I can easily, easily imagine a winning soccer team made up entirely of robots. If I was rich I would tempt you with money to hasten the creation of such a thing.

What I can not imagine - or rather, what I am unable to conceive a route towards - is a robotic soccer player that announces one day it is sick of putting balls into goals and is retiring to take up painting instead.

Or take chess. I can't beat my computer at it any more, although that's not saying much as I was never all that good. Yes, I can envision a chess program that says 'hmm, you keep losing, how about I start without a pawn until you improve?'. Indeed, we're not so far away from being able to build a good chess tutor, not least because chess play has a fully defined grammar and so winning positions in chess games could be regarded as true statements in a formal system. On the other hand, further development in this area is unlikely to produce software with a secret addiction to backgammon.

We have software that can create pictures or music in a certain style. But although they can produce interesting and unexpected results they're still horrendously limited in other ways. If you request a new composition and don't like the results, will your computer denounce you as an ungrateful philistine, while mocking your bourgeois notions of formalism?

Computers don't want to do things. We want them to do things, and currently all we know how to do is build simulacra of ourselves. Doubtless, as time goes on, we will be able to build more general-purpose simulacra - our robotic soccer players will also compete at rugby and tennis, our chess programs will handle a wider domain of dynamic analytical problems, our artistic software will employ inductive processes that begin with general concepts of proportion, contrast and so forth.

But we are not going to get to real artificial intelligence until we start building systems that are a) self-modifying and b) allowed to engage in perverse behavior whose purpose is not obvious to us.

There are no comments on this comment yet.