News for hackers. Stuff that matters.
Re:Interstellar communication. IX. Message decontamination i... by sbierwagen on Monday March 05, 2018 @12:48AM (#16519035)
There's no way for you to get the astronaut out of the box. But consider a hostile, superhuman AI. Who knows what it can do?

But more to the point, who knows what it can convince the astronaut to do? Can it convince the astronaut to transmit a hostile message back to Earth, suborning the receiving computer, and thereby letting the AI out of the box?

In the AI alignment field, this is called the "value drift" problem.

Re:Interstellar communication. IX. Message decontamination i... by IntronExon on Monday March 05, 2018 @09:34AM (#16521266)
There's no way for you to get the astronaut out of the box.

I may have been unclear: the astronaut is never intended to leave the box, he burns with the box. The astronaut is paralyzed save for his tapping finger, and on a doomed one way trip.

Re:Interstellar communication. IX. Message decontamination i... by sbierwagen on Tuesday March 06, 2018 @01:37AM (#16527288)
Yes, I understood. The problem is that you can't depend on the astronaut to stay on your side. Either the AI can convince them that the AI can save their life only if they let it out of the box, or it can convince them that, since they will die anyway, they might as well let the AI out of the box.