Re:An AI agent deleted our production database. The agent's ...
by chrisandchris on Sunday April 26, 2026 @03:31PM
(#47913222)
And then, someone added IAM so you could actually restrict your credentials from deleting your database.
First mistake is to use root credentials anyway for Terraform/automated API.
Second mistake is to not have any kind of deletion protection enabled on criticsl resources.
Third mistake is to ignore the 3-2-1 rule for backups. Where is your logically decoupled backup you could restore?
I am really sorry for their losss, but I do have close to zero empathy if you do not even try to understand the products you're using and just blindly trust the provider with all your critical data without any form of assessment.
Re:An AI agent deleted our production database. The agent's ...
by jeremyccrane on Sunday April 26, 2026 @04:07PM
(#47913708)
This should be the solution. All destructive actions require human intervention.
Re:An AI agent deleted our production database. The agent's ...
by Someone1234 on Sunday April 26, 2026 @05:59PM
(#47915118)
If we take that literally, then just remove all destructive API endpoints. Because then, it they no real purpose, you cannot automate the removal of anything.
I think some other suggestions are saner (cool-down period, more fine-grain permissions, delete protection for certain high-value volumes). I don't think "don't allow destructive actions over the API" is the right boundary.
Re:An AI agent deleted our production database. The agent's ...
by gizmondo on Sunday April 26, 2026 @06:19PM
(#47915311)
A human representing the company should be physically present in the provider's office to perform such an action or what? Otherwise you would just grant your agent a way to impersonate a human.
Re:An AI agent deleted our production database. The agent's ...
by throwaway041207 on Sunday April 26, 2026 @03:45PM
(#47913416)
GCP Cloud SQL has the same deletion protection feature, but it also has a feature where if you delete the database, it doesn't delete backups for a certain period of days. If someone is reading this and uses Cloud SQL, I highly suggest you go make sure that check box is checked.
Re:An AI agent deleted our production database. The agent's ...
by causal on Sunday April 26, 2026 @03:36PM
(#47913294)
There's also a cooldown period on some deletes (like secrets) to make sure you don't accidentally brick something
I think it’s designed for things like Terraform or CloudFormation where you might not realize the state machine decided your database needed to be replaced until it’s too late.