Re:Behind the stick of the SR-71
by dredmorbius on Saturday March 08, 2014 @03:10AM
(#7364609)
it seems to me to be an argument about why we keep humans "in the loop"
That's helpful but not sufficient.
• It doesn't address the criticality of appropriate feedback controls and limits. People and algorithms both make bad decisions.
• A given group of humans might not act in the best interests of all humans, or even a specified larger group, or even themselves.
Re: how innovative we want to be even with defensive weapons. Body armor is generally far less dangerous than an RPG or assault rifle. But defensive technologies such as antibiotics can, if misused, lead to larger downstream threats (through antibiotic resistance). The areas of unintended consequences, moral and morale hazard, and the like, make for fascinating study.
Re: the bomb. Yes, the Germans and Japanese were both conducting nuclear research (though I believe the Japanese project was limited and/or curtailed). Another interesting speculation I've seen is of what might have happened had the US not used the atomic bomb on Hiroshima and Nagasaki: it's possible that the true horrors of the weapon wouldn't have been realized and that the next military action (the Korean War) might have gone nuclear.
The places where I've been spending time looking at things are a bit more nuanced though: sustainability in light of finite resources and/or maximum flows: is saving lives really an unalloyed good? What of technology in general which might increase technological risks (simply of failure). Was the Green Revolution a good thing? Humans have been something of a paperclip maximizer, except that our paperclips are humans. In the long run even that may not work out for us. Systems need negative feedback loops.
That's helpful but not sufficient.
• It doesn't address the criticality of appropriate feedback controls and limits. People and algorithms both make bad decisions.
• A given group of humans might not act in the best interests of all humans, or even a specified larger group, or even themselves.
Re: how innovative we want to be even with defensive weapons. Body armor is generally far less dangerous than an RPG or assault rifle. But defensive technologies such as antibiotics can, if misused, lead to larger downstream threats (through antibiotic resistance). The areas of unintended consequences, moral and morale hazard, and the like, make for fascinating study.
Re: the bomb. Yes, the Germans and Japanese were both conducting nuclear research (though I believe the Japanese project was limited and/or curtailed). Another interesting speculation I've seen is of what might have happened had the US not used the atomic bomb on Hiroshima and Nagasaki: it's possible that the true horrors of the weapon wouldn't have been realized and that the next military action (the Korean War) might have gone nuclear.
The places where I've been spending time looking at things are a bit more nuanced though: sustainability in light of finite resources and/or maximum flows: is saving lives really an unalloyed good? What of technology in general which might increase technological risks (simply of failure). Was the Green Revolution a good thing? Humans have been something of a paperclip maximizer, except that our paperclips are humans. In the long run even that may not work out for us. Systems need negative feedback loops.