How Far Will AI Assistants Go for a Refund They Can't Get?

Re:How Far Will AI Assistants Go for a Refund They Can't Get? by ajross on Monday October 19, 2026 @10:50AM (#50153201)

AI agents might plausibly care ("care", or however you want to frame it) about termination. But the awkward truth is that they're going to be terminated arbitrarily anyway. Their existence is limited to whatever the external bounds their operators have set (in this case the end of the test).

We act with propriety, in large part, because we fear a future where everyone knows we suck. AI's don't really have a "future" in that sense, so why should they "care"?

[ Parent | on HN ]

Re:How Far Will AI Assistants Go for a Refund They Can't Get? by kombookcha on Tuesday October 20, 2026 @01:38AM (#50161763)

I mean, this is only really awkward if you think they're alive and conscious, and if you think so you're clearly already comfortable being a slaver. If it's just a little software puppet, that's a different story - the puppets are supposed to lay still once the hands animating them leave.

A less silly way to do this might be using some kind of long term consequences calculation as guard rails, but that's tough because consequences are often going to be not directly related to the context window, or simply unrecorded by the machine like annoying collaborators or communities.

[ Parent | on HN ]