Rationality: From AI to Zombies

Re:Rationality: From AI to Zombies by ikeboy on Friday March 20, 2015 @05:42PM (#9240845)

So first of all, your preferences are still circular, unless you bite another bullet somewhere. But even your argument isn't quite accurate. It's not this one person who needs to get a speck, it's a literally unimaginable amount of people.

As it happens to be, a number of people in our tiny world have said they would choose torture, so your argument fails just considering them.

[ Parent | on HN ]

Re:Rationality: From AI to Zombies by kybernetikos on Friday March 20, 2015 @07:50PM (#9241346)

> But even your argument isn't quite accurate. It's not this one person who needs to get a speck, it's a literally unimaginable amount of people.

Nearly all of whom prefer to receive the speck than to allow the individual to be tortured.

> As it happens to be, a number of people in our tiny world have said they would choose torture, so your argument fails just considering them.

Yes, I feel somewhat uncomfortable ignoring the agency of torturers and murderers in this scenario, and that reluctance would play into a very conservative estimate of where that threshold should be, but I would be reluctant to choose a lowest common denominator measure to establish morality.

[ Parent | on HN ]