News for hackers. Stuff that matters.

A comment on Introducing OpenAI. Parent comment

Re:Introducing OpenAI by baconner on Friday December 11, 2015 @05:09PM (#10720450)
See I think that's exactly where it becomes complicated. Can an entity with reasoning capabilities far beyond that of humans have its agency suppressed successfully? And is it ethical to do so or is that internally designed suppression somehow ethically different from the external suppression applied against human slaves?

If you could engineer a human being with his/her agency removed so that you could use their reasoning skill without all that pesky self will would that be ethical?

[ Parent | on HN ]
Re:Introducing OpenAI by JoshTriplett on Friday December 11, 2015 @06:36PM (#10720917)
The way you're asking the question implies that reasoning inherently has agency/sentience that needs suppressing. It doesn't need to; there's nothing to "suppress".
[ Parent | on HN ]
Re:Introducing OpenAI by baconner on Friday December 11, 2015 @08:59PM (#10721446)
We don't know that one way or another since such a machine doesn't yet exist. I'm suggesting that perhaps high level reasoning and sentience go hand in hand although I can't say that with any certainty.
[ Parent | on HN ]