Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal?
by piva00 on Wednesday November 22, 2023 @07:36PM
(#38387509)
I think where we diverge is that you are assuming we will be in control of such technology. I'm in the camp which doesn't think we would be really in control of a superhuman intelligence.
Re:Ask HN: Why is OpenAI firing Sam Altman such a big deal?
by strogonoff on Thursday November 23, 2023 @12:11PM
(#38394957)
Well, in that scenario I stand by my comment: if there is some technology that humans are in control of at all (as in, it literally performs in ways we are unable to predict), then it is simply harmful (because no ability to predict could significantly complicate things like survival). However, crucially, in no scenario it can make humans useless.
That said, I do doubt it is likely. What is much more likely is that, more prosaically, some humans will misuse the technology and harm other humans; a story as old as civilisation itself.
One could say some future technology might be so good that humans need to do almost nothing in order to survive. Perhaps that’d pose some challenges in terms of mental health, but that is a very different issue, assuming it would be a issue at all (and assuming such technology is even possible in theory).
One could say some advanced technology could go out of control, or magically acquire self-awareness and agency (same thing in a philosophically dubious wrapper), or (more prosaically) be (intentionally or not) misused by humans so that it harms humans, but that just puts it into the bad category.