Re:US military AI drone simulation kills operator, then take...
by adhesive_wombat on Friday June 02, 2023 @06:04AM
(#36163227)
Yes, if this happened at all, either the military AI used here is far, far more advanced and was able to synthesise the action from whole cloth (in which case they're not going to blab about it on the internet), or the option to kill the operator was explicitly put in as an first-class "lever" the AI was given, or the whole thing is PR fluff to "start a conversation".
[ Parent
| on HN ]
Re:US military AI drone simulation kills operator, then take...
by wokwokwok on Friday June 02, 2023 @06:18AM
(#36163314)
It might not be real, but emergent behaviour in self-play is a thing [1], and it’s not that hard to imagine a simulation where some random action (destroy comms tower, etc) resulted in unbounded point scoring and became a learnt behaviour.
You’d have to have an enormously complex and detailed simulation, simulated repeatedly, for this to happen, but it’s not totally beyond the realms of possibility.
[1] - https://openai.com/research/emergent-tool-use, scroll to the end re “surprising behaviour”.