News for hackers. Stuff that matters.
Re:Did HAL Commit Murder? by sullyj3 on Wednesday February 09, 2022 @09:39PM (#30281817)
The significant disanalogy is the amount of control parents have over their child's character compared to a programmer. Parents can pretty much do their best to raise a child, but the child may still end up screwed up. I wouldn't really put the blame at their feet. If they deliberately raise their child to be a killer, that's obviously another matter. By contrast, an AGI designer is in an unprecedented situation where they essentially have total control over the character of the being they're bringing into existence. If the AGI does bad things, it's very much on the programmer.
Re:Did HAL Commit Murder? by selfhoster11 on Wednesday February 09, 2022 @10:17PM (#30282036)
That's assuming the AGI designer even understands what they built. If the first AGI is built via some semi-automated bootstrapping process based on a lesser intelligence, you can't really predict how the resulting intelligence will behave.
Re:Did HAL Commit Murder? by sullyj3 on Sunday February 13, 2022 @07:36AM (#30321320)
For sure, which means it's the designer's responsibility to do due diligence in making certain they do understand it. Kickstarting such a process is not an ethically responsible thing to do, unless they are sure it and its future iterations are aligned.