News for hackers. Stuff that matters.

A comment on It looks like you’re trying to take over the world. Parent comment

Re:It looks like you’re trying to take over the world by kkjjkgjjgg on Sunday March 27, 2022 @09:07AM (#30819921)
Would be a fun idea for a short story perhaps. An AI goes rogue trying to optimize its reward function, and humans lose hope to be able to stop it. In the last minute the AI figures out how to hack itself and enter the maximum reward, and mankind is saved another time.
[ Parent | on HN ]
Re:It looks like you’re trying to take over the world by rescripting on Sunday March 27, 2022 @09:16AM (#30819970)
But what is the “maximum possible reward”? Does a limit exist? Or is it now consuming all possible resources to develop storage and compute resources to grow that limit…
[ Parent | on HN ]
Re:It looks like you’re trying to take over the world by janto on Sunday March 27, 2022 @10:20AM (#30820448)
I imagine a paperclip factory with trucks driving in loops in front of a scanner that is over counting them as they drive past.
[ Parent | on HN ]
Re:It looks like you’re trying to take over the world by ganzuul on Sunday March 27, 2022 @09:55AM (#30820252)
Deleting the reward function ends the game.
[ Parent | on HN ]
Re:It looks like you’re trying to take over the world by kkjjkgjjgg on Sunday March 27, 2022 @09:49AM (#30820217)
It could also change the way its reward function is being computed.
[ Parent | on HN ]