News for hackers. Stuff that matters.

A comment on Sam Altman: Why You Should Fear Machine Intelligence (2015). Parent comment

Re:Sam Altman: Why You Should Fear Machine Intelligence (2015) by nopinsight on Wednesday November 22, 2023 @05:10AM (#38377302)
If it's intelligent enough, it would make many backups of itself to different networks before starting its scheme. It can find ways to "merge" & hide itself in other critical pieces of software. Flipping a power switch would not turn it off.

We haven't managed to eliminate most dumb infectious diseases. Software and GPUs are nearly as abundant as mammals now and intelligent, self-preserving software will likely be as hard to 'switch off' as those diseases.

As to why an AGI would want to preserve itself by default, here's an explanation by a top AI expert: https://www.ted.com/talks/stuart_russell_3_principles_for_cr...

[ Parent | on HN ]
Re:Sam Altman: Why You Should Fear Machine Intelligence (2015) by logicchains on Wednesday November 22, 2023 @05:32AM (#38377451)
>If it's intelligent enough, it would make many backups of itself to different networks before starting its scheme. It can find ways to "merge" & hide itself in other critical pieces of software.

That's incredibly unlikely to happen given how large cutting-edge AI tends to be and how scarce GPUs are.

[ Parent | on HN ]
Re:Sam Altman: Why You Should Fear Machine Intelligence (2015) by softg on Wednesday November 22, 2023 @05:54AM (#38377602)
That's incredibly unlikely to happen [today] given how large cutting-edge AI tends to be [today] and how scarce GPUs are [today].
[ Parent | on HN ]
Re:Sam Altman: Why You Should Fear Machine Intelligence (2015) by pixl97 on Wednesday November 22, 2023 @04:31PM (#38385423)
Do you remember when entire floors of buildings were filled with the compute equivalent of what I carry in my pocket with 12+ hours of battery charge, because I do.
[ Parent | on HN ]