I completely agree that's a valid argument. I just think it is rational for someone to come to a different conclusion, given identical priors.
If it wasn’t clear, I agree with your parent comment
My main takeaway from Bostrom's Superintelligence is that a super intelligent AI cannot be contained. So, the slippery slope argument, often derided as a bad form of logic, kind of holds up here.
Re:Universal Paperclips
by olddustytrail on Wednesday August 02, 2023 @06:57PM
(#36979001)
The massive flaw in your argument is your failure to define "we".
Replace the word "we" with "a psychotic group of terrorists" in your post and see how it reads.
Re:Universal Paperclips
by actionfromafar on Wednesday August 02, 2023 @08:08PM
(#36979621)
Or "board of directors beholden to share-holders".
If you’re talking about some group of evildoers that deploy ai in a critical system to do evil… the issue is why do they have control to the critical system? Surely they could jump straight to their evil plot with the ai at all
Re:Universal Paperclips
by olddustytrail on Thursday August 03, 2023 @03:45PM
(#36990801)
Your question is equivalent to "if you have access to the chessboard anyway, why use Stockfish, just play the moves yourself."
if we build ai AND THEN we give it a stupid goal to optimize AND THEN we give it unlimited control over its environment, something bad will happen.
the conclusion is always "building AI is wrong" and not "giving AI unrestricted control of critical systems is wrong"