News for hackers. Stuff that matters.
Re:The Myth of AI by ThomPete on Friday November 14, 2014 @04:07PM (#8609499)
I think it's important to realize that AI doesn't have to have bad intent to do us harm.

Al it need for AI to have horrible consequences is for us to rely on it more and more and thus allow it to control more and more parts of our lives.

I don't fear the human level intelligent AI I fear the rat level intelligence that comes before.

Re:The Myth of AI by JoeAltmaier on Friday November 14, 2014 @04:11PM (#8609516)
Right; many moral dilemmas are easy to solve if you have no conscience. 10 people on the tracks? switch the engine to run over one child.
Re:The Myth of AI by anigbrowl on Friday November 14, 2014 @04:52PM (#8609718)
Moral dilemmas are easy to solve if you have perfect information. In the train-track problem you reference, the utility of saving 10 people at the expense of 1 life is obvious and I would do so without hesitation (though not without regret). But life rarely presents us with cases where the utilitarian calculus is so clear; our powers of foresight and analysis are so limited that we get better results by establishing and promulgating rules that cover the most common situations - imperfectly, but with tolerably low error levels.
Re:The Myth of AI by defen on Friday November 14, 2014 @05:11PM (#8609820)
> In the train-track problem you reference, the utility of saving 10 people at the expense of 1 life is obvious and I would do so without hesitation (though not without regret)

Even if it were your own child?

Re:The Myth of AI by anigbrowl on Friday November 14, 2014 @07:29PM (#8610376)
That's an entirely different problem, though, since I have a selfish interest in preserving my own lineage at the expense of others'. It's an interesting moral problem - just how many people's lives would I be willing to sacrifice to save a member of my own family? - but orthogonal to the point I was making.
Re:The Myth of AI by sp332 on Friday November 14, 2014 @05:18PM (#8609848)
Even if the answer is no, how does that relate to anigbrowl's point? (or were you just curious?)
Re:The Myth of AI by defen on Saturday November 15, 2014 @03:49AM (#8611232)
From a "purely utilitarian" perspective your relation to the people involved is not relevant. That's assuming the existence of some "universal" utility, not one specific to the person deciding.
Re:The Myth of AI by chnx on Friday November 14, 2014 @05:25PM (#8609877)
Five mortally ill patients are in care at a hospital, all of whom will soon die. At the same time, a sixth man is undergoing a routine checkup at the same hospital. A transplant surgeon in residence finds that the only medical means of saving the five ailing patients would be to slay the sixth and transplant into them his healthy organs. Legal ramifications and other peripheral matters disregarded, it morally right to do so?
Re:The Myth of AI by anigbrowl on Friday November 14, 2014 @07:56PM (#8610442)
Ah, I was hoping someone would bring this one up. My answer there is no, because it's not a zero-sum issue like the points on the train track. Let's analyze the differences. For consistency, I'll assume the version of the train track problem where 5 people are going to die if I do nothing and let the train continue on its present course, vs 1 if I reach out and actively switch the train onto a different track. (There are other versions of the problem but this has the most similarity to the transplant problem.)

Now it's true that if I divert the train I'm actively choosing to end the life of the single person on track B in order to save a greater number of people on track A. But the key difference is the external force of the train; it's going to hit someone, so we might as well ensure it hits as few as possible. In the transplant situation, you have 5 patients who are dying from 5 different illnesses of their own; they're not going to die because they're in hospital, they're in hospital because they're going to die. Likewise, they won't be saved by the death of the healthy patient, but by the harvest of his healthy organs. And this harvesting would have to be conducted by the transplant surgeon - and getting killed by an overzealous surgeon is qualitatively very different from getting killed by liver failure or whatever.

Oddly, nobody ever seems to consider the possibilities in letting one of the mortally ill patients die and then sharing out that person's organs among the 4 remaining patients, which is obviously a less good result than saving all 5 of them but also much less troubling than murdering patients who aren't planning on donating their own organs.Assuming they needed 5 different organs and were all equally close to death (such that we couldn't wait around for one of them to die at random and save the other four), then you run into the question of whether it's morally acceptable to kill one of the terminally ill patients in order to save the other four (again assuming imminence of death and perfect knowledge of outcomes and so on, which is rarely the case in the real world). Most people would still say no, but I'd be inclined to say yes.

Re:The Myth of AI by JoeAltmaier on Friday November 14, 2014 @05:41PM (#8609950)
That's often used as an obvious parallel situation that makes it clear. But its not quite true: the healthy patient is not really involved with the situation of the other 5. Unlike the child, who is inevitably linked to the outcome of the others on the tracks. This new feature means the doctor is forcing the healthy person to play the game, which is certainly not right, and is the forcing issue that makes it clearly wrong.
Re:The Myth of AI by barbudorojo on Saturday November 15, 2014 @08:55AM (#8611675)
What if we compute the value of a person life at a certain age as the difference between the life expectancy and his age. Then ten very old people could be less valuable than one child? That axiom is sound and your claim doesn't hold.
Re:The Myth of AI by JoeAltmaier on Monday November 17, 2014 @11:25AM (#8618858)
What if we calculate value as experience? Then the child doesn't matter.
Re:The Myth of AI by bad_user on Friday November 14, 2014 @04:33PM (#8609625)
It's worse than that - human-like intelligence will never happen, because our intelligence is a function of our experience as we grow up and our human body.

An AI can surely surpass us, but it'll never be quite like us - so question is, will such an AI have compassion for humans, or what will stop it from hurting us? After all, I'm not so fond of humans either, as we've been exterminating entire species and damaging our habitat. And the answer is - there's no reason to believe that such an AI will support the continued existence of mankind, quite the contrary, as we may be seen as a threat to its survival.

Re:The Myth of AI by therealdrag0 on Friday November 14, 2014 @04:54PM (#8609734)
Why treat AI like a single thing? Wouldn't the openness of code lead to a plethora of AI with different demeanors, towards humans, life, and each other?
Re:The Myth of AI by bad_user on Friday November 14, 2014 @07:03PM (#8610287)
I don't think so. If we are speaking of an AI that is self-aware, then code will have as much to do with its behavior as our own DNA.

I also think that even if multiple AIs happen, they'll converge into a single one. If we would be able to connect to other people's feelings and thoughts, would we would still be able to think and act as individuals? I don't think so.

This is what I meant above - an AI will not grow in a human body to have a human-like childhood, will not receive input from the same sensors we have and will not have the same limitations that we do. For example, contrary to us, it will have an enormous memory capacity, which is interesting if you think about it, because for the human brain forgetfulness can be seen as a feature.

Re:The Myth of AI by therealdrag0 on Friday November 14, 2014 @08:12PM (#8610485)
I agree that it wouldn't be shaped by a childhood, but I think it merging into one is entirely optional.

"code will have as much to do with its behavior as our own DNA." That's what I was saying, and that can be changed to be significantly different just by changing the code.

Re:The Myth of AI by vertex-four on Friday November 14, 2014 @05:31PM (#8609904)
We don't have a reasonable open web search engine - what leads you to think it's definite that we'll have a top-of-the-range open AI?
Re:The Myth of AI by therealdrag0 on Friday November 14, 2014 @05:36PM (#8609925)
I don't think it's definite at all; I'm just remarking in a conversation of speculation.
Re:The Myth of AI by kolev on Friday November 14, 2014 @04:14PM (#8609538)
I am talking about AI for problem solving, not giving it control via robotics and other means over the physical world.
Re:The Myth of AI by anigbrowl on Friday November 14, 2014 @04:56PM (#8609742)
An AI in a box is only going to be as good as the problem statements and axioms that you load it up with. What you actually want is an AI that can make useful inferences on our behalf, which is going to require some sort of self-concept.
Re:The Myth of AI by ThomPete on Friday November 14, 2014 @04:25PM (#8609593)
I honestly don't think you can separate that.

Problem solving is also making AI control an anti missile defence shield our nuclear reactors, food production and so on.