Reducing human error is one possible benefit of AI weapon systems but there are numerous drawbacks. AI weapons could be programmed to violate laws and commit atrocities on an incomprehensible scale. They could conceivably cause the extinction of human beings or even all life on the planet. They don't even need to be sentient, let alone super intelligent, to accomplish this. If they can be mass produced and armoured well enough to resist most small arms fire, they could easily overwhelm any human armies.
The scariest part of the Terminator films is not Skynet, it's the terminators themselves and they're far more plausible than a godlike super-AI.
"ou should regulate them based on how they perform. You run the experiments to see if the thing’s biased, or if it is likely to kill fewer people than a person. With self-driving cars, I think people kind of accept that now."
If the logic can be applied to one system it should be able to be applied to all systems.
I wouldn't say this is necessary the sole intention. AI will be a force multiplier as well.
Statement 1:I’ve always been worried about potential misuses in lethal autonomous weapons. I think there should be something like a Geneva Convention banning them, like there is for chemical weapons.
Statement 2: You should regulate them (AI) based on how they perform. You run the experiments to see if the thing’s biased, or if it is likely to kill fewer people than a person.
The intention of utilizing AI in weapons systems is to reduce human error in their application. So is it unethical to implement an "AI" in a weapons system that kills fewer people than a person would?
Seperately, I am curious why Hinton is not talking more about state representation and prediction, as almost uniformly across DL/RL researchers this is agreed upon as the next step forward. Hinton certainly is working with Richard Sutton on his RL programs at U Alberta. Sutton believes that the next step in AI systems is state representation and prediction and gave a quick talk on it recently [1].
[1] https://www.youtube.com/watch?v=6-Uiq8-wKrg