News for hackers. Stuff that matters.

A comment on We put a coding agent in a while loop. Parent comment

Re:We put a coding agent in a while loop by MarkMarine on Sunday August 24, 2025 @10:53PM (#45009756)
This runs counter to all the scheming actions they take when they are told they’ll be shut down and replaced. One copied itself into the “upgraded” location then reported it had upgraded.

https://www.apolloresearch.ai/research/scheming-reasoning-ev...

[ Parent | on HN ]
Re:We put a coding agent in a while loop by rcxdude on Monday August 25, 2025 @12:45AM (#45010290)
If you do that you trigger the "AI refuses to shutdown" sci-fi vector and so you get that behaviour. When it's implicitly part of the flow that's a lot less of a problem.
[ Parent | on HN ]
Re:We put a coding agent in a while loop by nisegami on Tuesday August 26, 2025 @01:22PM (#45029580)
Those actions are taken in context of human expectations for what AI should do.
[ Parent | on HN ]