News for hackers. Stuff that matters.
Re:Ask HN: How do you roll back production? by Angostura on Sunday November 03, 2019 @12:00PM (#21435029)
They you just have to worry about rolling back the changed database schema that you have rolled out to both green and bluie variants - I presume. That bit feels tricky
Re:Ask HN: How do you roll back production? by gfodor on Sunday November 03, 2019 @12:03PM (#21435052)
Yep, that's a fair point. In scenarios where you have made non-backwards compatible database changes, this approach cannot be used. Typically the dark cluster is accessible for pre-flight testing, so you can run tests there to determine if the service is still operating as expected despite the database being one migration step ahead. In your response runbook, you should have a contingency for the scenarios where that happens. (For many projects, the % of changes that have this characteristic are small enough that it doesn't move the needle on the risk profile, but Murphy's law can mess with you :))