Re:The Myth of a Superhuman AI
by mikeash on Wednesday April 26, 2017 @08:27PM
(#14208228)
We see this problem of the parts competing with each other in humans. When cells abandon their part in the collective and start optimizing for their own reproduction, we call it cancer. The main way we solve this is by shutting everything down when this happens, and creating new ones from a single cell that hasn't evolved to be selfish yet.
The problem may be inevitable, but that doesn't mean it's insurmountable.
The problem may be inevitable, but that doesn't mean it's insurmountable.