Re:US military AI drone simulation kills operator, then take...
by wokwokwok on Friday June 02, 2023 @06:18AM
(#36163314)
It might not be real, but emergent behaviour in self-play is a thing [1], and it’s not that hard to imagine a simulation where some random action (destroy comms tower, etc) resulted in unbounded point scoring and became a learnt behaviour.
You’d have to have an enormously complex and detailed simulation, simulated repeatedly, for this to happen, but it’s not totally beyond the realms of possibility.
You’d have to have an enormously complex and detailed simulation, simulated repeatedly, for this to happen, but it’s not totally beyond the realms of possibility.
[1] - https://openai.com/research/emergent-tool-use, scroll to the end re “surprising behaviour”.