That doesn't even rise to the level of proof-by-disbelief; it's proof by hypothetical future disbelief. You've given no more reason to be confident in your hypothetical than the concerns about hypothetical self-improving AIs.
You're failing to sell this argument to someone generally inclined to agree with you about the outcome.
Re:Artificial intelligence risk research
by andreyf on Saturday December 12, 2015 @09:57PM
(#10725221)
What is proof-by-disbelief? I'm not trying to prove that HGI is impossible, nor do I think it's impossible.
However, until one proposes a concrete methodology for modeling the world which includes the method that is doing the modeling (self-awareness), a decision making process, and a way to take action autonomously and without intervention, it's very hard to talk generally about preventing catastrophic bugs.
Re:Artificial intelligence risk research
by eli_gottlieb on Saturday December 12, 2015 @05:10PM
(#10724357)
Just because we will understand, in principle, how to control it, doesn't mean we'll engineer that control particularly well.
The fear and idea of somehow creating an HGI without understanding how to control it came from The Terminator. It's pure fantasy.