Supercomputers used to be giant machines we had in giant warehouses... Now the phone in your pocket has the computing power of the 1980s walking around with you. Assuming your super intelligence will always be huge is... well not a great assumption.
Also superintelligence doesn't need a body itself. It just needs yours. Putin for example has commanded hundreds of thousands of dumbasses to go get themselves killed in Ukraine. In this case does it matter if Putin is flesh and blood, or a processor that lists out commands for others to follow as long as they are willing to listen?
Re:Uncensored (Language) Models
by leroy-is-here on Monday May 15, 2023 @10:22AM
(#35948613)
My point is that a superintelligence will require specialized equipment. I specifically mentioned it because there is a thought that a superintelligence can just replicate itself onto your phone, as you mentioned.
But this replication must follow the physical laws we have. It must also follow the laws we attempt to enforce in our networks.
But you are correct, if a superintelligence were to somehow convince a human to rid itself of agency, sure.
Or could it just get some money, buy some AWS compute, and make a copy of itself there? How would you know if you'd turned all of it off?
>if a superintelligence were to somehow convince a human
Hey bro... do you want some...MONEY!
It doesn't take much.
Re:Uncensored (Language) Models
by iainmerrick on Monday May 15, 2023 @10:06AM
(#35948336)
Who's "we"?
Re:Uncensored (Language) Models
by leroy-is-here on Monday May 15, 2023 @10:19AM
(#35948565)
Humanity.
Re:Uncensored (Language) Models
by iainmerrick on Monday May 15, 2023 @12:01PM
(#35950402)
Good thing we're all aligned the same way, then!
Re:Uncensored (Language) Models
by leroy-is-here on Monday May 15, 2023 @12:42PM
(#35951000)
Alignment doesn’t matter. Humanity is attempting to build artificial intelligence and so it will be done.
Maybe in the far, far future when we have androids which can house an AI we will have to worry. But designing a body is one problem. Designing an intelligence is another.