News for hackers. Stuff that matters.
Re:Interstellar communication. IX. Message decontamination i... by obblekk on Sunday March 04, 2018 @08:02PM (#16517914)
The way I read the title was: \forall messages M s.t. \forall decontaminating functions F, F does not decontaminate M.

I think what the paper actually shows is \exists message M, s.t. \forall decontaminating functions F, F does not decontaminate M.

In fact, we know the title (as I interpreted it) is false - the paper gives an example of a message that can be read as plain text which can be truly decontaminated.

Basically, when we get a message, we'll be able to immediately tell whether we can decontaminate it or not. If not, the paper argues we're doomed because eventually it'll leak. I just don't find that to be very interesting, and definitely not as strong a claim as the title (as I interpreted it).

Re:Interstellar communication. IX. Message decontamination i... by pdonis on Sunday March 04, 2018 @09:45PM (#16518341)
> when we get a message, we'll be able to immediately tell whether we can decontaminate it or not

I don't think this is true (at least not "immediately").

The paper is arguing that we will need computers to help decode any non-trivial message, and any computer program capable of decoding a non-trivial message will be Turing complete, and hence capable of running virus code that could have damaging or destructive effects. (The paper's example was a message containing equations in LaTeX, which is Turing complete, hence an ETI could embed a virus in LaTeX code, and humans might not be able to spot it.)

The strategy the paper is advocating, as far as I can see, is that, unless the message is simple enough that humans can decode it without computer help, and thereby check directly whether it contains any dangerous information, the message should be destroyed. I suppose this could count as "we can't tell whether we can decontaminate it", but I'm not sure that's what you meant.

Re:Interstellar communication. IX. Message decontamination i... by IntronExon on Sunday March 04, 2018 @09:49PM (#16518367)
I suppose one option is to stick a computer, not networked, on a small spacecraft along with a single astronaut and pop them into LEO. Run the code, and have the astronaut tell us what it says or does. If something goes wrong, the whole thing deorbits. If we’re really paranoid we could send it well past LEO.

Edit: If we were incredibly paranoid and had some self-sacrificing astronauts it could be a one-way trip to Mercury.

Re:Interstellar communication. IX. Message decontamination i... by nordsieck on Sunday March 04, 2018 @11:15PM (#16518680)
It sounds like you've never heard of the AI Box Experiment[0]. I personally don't believe that there is any way to safely do isolation while still maintaining the potential to transmit the message.

[0] http://yudkowsky.net/singularity/aibox/

Re:Interstellar communication. IX. Message decontamination i... by jcadam on Monday March 05, 2018 @12:13AM (#16518899)
This is actually the first time I've heard of this. Interesting, but I find it hard to believe the gatekeeper wouldn't just decide to turn into an obstinate 3-year-old and thus win the challenge :)
Re:Interstellar communication. IX. Message decontamination i... by qubex on Monday March 05, 2018 @04:45AM (#16519900)
What if we let the potentially malicious AI of extraterrestrial origin be managed by a trusted AI of our own manufacture and that is proven cannot be swayed by arguments such as those commonly indicated could corrupt a human?

Just speculating, without knowing how we could get to such a predicament.

Re:Interstellar communication. IX. Message decontamination i... by nordsieck on Tuesday March 06, 2018 @01:15AM (#16527222)
1. How would you go about creating an AI?

2. How would you identify that what you've created is an AI?

3. Under what circumstances would you decide to trust the AI that you've created?

4. Under what circumstances would you be confident to feed a potentially malicious potential AI to your trusted AI?

Re:Interstellar communication. IX. Message decontamination i... by IntronExon on Sunday March 04, 2018 @11:28PM (#16518722)
We could restrict the astronaut to using Morse code, and have literally no other data link back to Earth. The astronaut can be immobilized except for one finger used to key the Morse code. The ship can be little more than a ballistic missile set to run a set number of orbits before burning in the atmosphere. There is no way out of that box, even if we want to let it out.
Re:Interstellar communication. IX. Message decontamination i... by sbierwagen on Monday March 05, 2018 @12:48AM (#16519035)
There's no way for you to get the astronaut out of the box. But consider a hostile, superhuman AI. Who knows what it can do?

But more to the point, who knows what it can convince the astronaut to do? Can it convince the astronaut to transmit a hostile message back to Earth, suborning the receiving computer, and thereby letting the AI out of the box?

In the AI alignment field, this is called the "value drift" problem.

Re:Interstellar communication. IX. Message decontamination i... by IntronExon on Monday March 05, 2018 @09:34AM (#16521266)
There's no way for you to get the astronaut out of the box.

I may have been unclear: the astronaut is never intended to leave the box, he burns with the box. The astronaut is paralyzed save for his tapping finger, and on a doomed one way trip.

Re:Interstellar communication. IX. Message decontamination i... by sbierwagen on Tuesday March 06, 2018 @01:37AM (#16527288)
Yes, I understood. The problem is that you can't depend on the astronaut to stay on your side. Either the AI can convince them that the AI can save their life only if they let it out of the box, or it can convince them that, since they will die anyway, they might as well let the AI out of the box.
Re:Interstellar communication. IX. Message decontamination i... by adrianN on Sunday March 04, 2018 @11:59PM (#16518845)
Things like artificial intelligences can be transferred via Morse code.
Re:Interstellar communication. IX. Message decontamination i... by IntronExon on Monday March 05, 2018 @09:36AM (#16521277)
Yes, but not through whatever a human can tap out in a relatively short period of time. Besides, you don’t need to receive the signal a computer, just a speaker and a guy with a pen and paper.
Re:Interstellar communication. IX. Message decontamination i... by dogma1138 on Monday March 05, 2018 @04:22AM (#16519792)
Isn’t that literally the plot of Life? That didn’t end up well....