Re:Misalignment and Deception by an autonomous stock trading...
by WhiskeyChicken on Monday November 20, 2023 @04:14PM
(#38354884)
Is there a specific reason we should expect that "instructing not to perform" an illegal activity should result in it adhering to said instruction? Is this any different than when it provides wrong output about other things, even when the operator attempts to "engineer" the prompt to guide the result?
[ Parent
| on HN ]
Re:Misalignment and Deception by an autonomous stock trading...
by nerdponx on Monday November 20, 2023 @04:37PM
(#38355213)
I'd be curious what would happen given RLHF to try to penalize illegal/immoral/unethical activity.
I had always dismissed Asimov's "rules of robotics" as silly: nobody would ever design a mission-critical robot with indeterminate stochastic behavior! Maybe I should reconsider and re-read those stories, because people seem very eager to do just that.
Re:Misalignment and Deception by an autonomous stock trading...
by staunton on Monday November 20, 2023 @05:32PM
(#38355855)
People will most definitely build such things (also into autonomous swarms of killer robots usedby the military, projects are ongoing...). However, Asimov's stories illustrate how difficult it is to find such rules. They are certainly not meant for inspiration how to actually program robots...